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FORWARD 


This report presents the results of the project for "The Analysis of 
the Statistical and Historical Infornation Gathered During the Develop' 
ment of the Shuttle Orbiter Primary Flight Software". This work was 
performed by the Texas Engineering Experiment Station of Texas A&M Univ- 
ersity, College Station, Texas. This work was performed for the Nation- 
al Aeronautics and Space Administration, Johnson Space Flight Center, 
Houston, Texas, under Grant NCC9~2. 

Principal investigators for the project were Drs. Dick B. Simmons, 
Miner P. Marchbanks, Jr. and Michael J. Quick. Major contributors to 
the project were Mr. Lee Boyajian. Nr. Blair Brenner, Ms. Karla Carroll, 
Mr. Richard Cox, Dr. Dan D. Drew, Ms. Janna Keel, Ms. Guylaine N, Pol- 
lock, Dr. Lariy J. Ringer, Dr. Sallie Sheppard, and Nr. Dennis Wilson. 

Major points of interest are covered in the body of the report with 
supporting information being included in the appendices. 
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ABSTRACT 


Presented here are the results of an effort to thoroughly and objective- 
ly analyze the statistical and historical information gathered during 
the development of the Shuttle Orbiter Primary Flight Software. The 
particular areas of interest include cost of the software, reliability 
of the software, requirements for the software and how the requirements 
changed during development of the system. Data related to the current 
ver ion of the software system produced some interesting results. Sug~ 
geslions are made for the saving of additional data which will allow ad- 
ditional investigation. 
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INTRODUCTION 


The Data Systems and Analysis Directorate (DSAD) of the Johnson Space 
Flight Center (JSC) has the responsibility for the implementation and 
maintenance of the Shuttle Orbiter Primary Flight Software. This soft- 
ware development project has involved a large number of software types, 
a large number of software management issues and a large number of soft- 
ware development methodology issues. During the course of the implemen- 
tation of this project a great deal of statistical and historical infor- 
mation has been gathered and retained within JSC. A research group at 
Texas A&M University (TAMU) composed of members from the Advanced Tech- 
nology Group of The Data Processing Center and members of the faculty of 
the Computing Science Department and the Institute of Statistics has un- 
dertaken the task of examining this information. 


1.1 DEFINITION OF PROJECT 

The object of this examination is to analyze the data gathered by JSC to 
determine what information can be used to provide NASA and the Software 
industry with additional metrics on the management and methodology is- 
sues surrounding large software implementation efforts. The software 
implementation data would hopefully produce data that could be of inter- 
est in areas such as cost, reliability, and requirements. With these 
areas of interest in mind, the task plan was organized into seven phas- 
es. The first phases involved key personnel visiting JSC to obtain in- 
formation relating to the definition of the Orbiter Software Project, to 
determ’ne what data is available for analysis, and to determine what 
analysis is to be done and products to be obtained. The latter phases 
will include putting data in machine readable form and producing re- 
sults. Tho seven phases are as follows; 

1. Produce a definition of the Orbiter Software Implementation 

2. Define and catalog the available data. 

3. Produce an estimation and prioritization of products, analyses 
and metrics. 

4. Produce final work and product plan and schedule. 
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5. Conduct data gathering and integration with periodic status re- 
ports. 

6- Put data in machine readable form. 

7. Analysis, results and final report incompassing the above phases. 

In areas of research where data was readily available, all of the above 
phases were completed. TAHU suggest that a continuing effort be carried 
on in other areas. 


1.2 AREAS OF RESEARCH 

The project has been organized into three areas of interest with person- 
nel assigned to information gathering task in each of three areas. 
These areas are the definition area, the code area and the changes area. 


1.2.1 Definition Area 

The definition area of analysis is primarily concerned with information 
about documentation, management, cost factors, and hardware constraints 
in the software development process. 


1.2.2 Code Area 

The code area of analysis is concerned with information about the source 
code. Statistics that can be gathered from HALSTAT, as well as statis- 
tics that can be gathered with the TAMU code analyzer, will be used to 
quantize source code characteristics. 


1.2.3 Changes Area 

The changes area of analysis is concerned with information related to 
changes made to the software during the development and testing process- 
es. Statistics are gathered with respect to Change Request <’CR) , Pro- 
gram Change Proposal (PCP) , and Discrepancy Reports (DR). Categories of 
change, with respect to the effect of the change and the priority of the 
change, will be analyzed. NASA's and IBM's characterization of the 
changes will be analyzed as well as a TAMU characterization of the 
changes . 
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ACCOMPLISHMENTS 


The work completed in this project has been categorized into the three 
main interest areas described in Section 1: definition, code and chang- 
es. .Accomplishments in each of these areas are presented following a 
brief literature survey which summarizes the conclusions of other work 
pertinent to this project. 


2.1 LITERATURE SURVEY 


During the last decade software engineering has become a major area of 
interest in computer science research.* ** In attempts to at- 
tain the software engineering goals of increasing system reliability and 
predicting software costs, researchers have conducted various program 
complexity and error analysis studies. This work has suggested using 
numerous metrics such as program length, operator/operand counts, nest- 
ing characteristics, data* sharing, and level of modularization as a me- 
ans of measuring the complexity of programs and in error estimation^ . 
The hypotheses formed in these studies have in general been tested using 
small data samples or student programs due to the difficulty in obtain- 
ing valid production data. 

Zolnowski^^ has developed a comprehensive scheme for assigning a fig- 
ure of merit to a program based on an objective set of program charac- 
teristics known to be related to program complexity. She has incorpo- 
rated the measures suggested by various other researchers on the 
assumption that the different opinions of these authors do in fact re- 
flect many diverse aspects of program complexity. She then evaluated 
the effectiveness of the various measures using objective data collected 
from the development of production programs in FORTRAN and COBOL. The 
complexity characteristics are divided into four categories: instruction 
mix, data reference, interaction/interconnection and structure/control 
flow. Based on Zolnowski's results a list of factors in each of these 
areas was compiled for use in estimating the complexity of the NASA 
space shuttle software written in HAL/S. This list is presented in Ap- 
pendix D. 

Carver* has extended the work of Zolnowski to determine the relationship 
between program changes and complexity characteristics for use in esti- 
mating program completeness based on changes. She defines the number of 
program changes to be the number of times the program code must be modi- 
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fied from the first version as written by the programmer to the final 
version at the end of the testing stage. In her model the program char- 
acteristics are measured in the first version of the program. In the 
study the number of changes were counted chronologically in the develop- 
ment of two large production software systems. Carver found that struc- 
ture/control flow characteristics were the best predictors of program 
changes. She also identified system-related conditions such as quality 
of the specifications, volatility of the system, and the use of struc- 
tured programming concepts to be critical for determining program chang- 
es. 


The work of Henry and Kafura*^ is typical of several recent research 
projects which define and validate a set of software metrics appropriate 
for evaluating the structure of large-scale systems. Their metrics are 
based on the measurement of information flow between system components; 
specifically, procedure complexity, module complexity and module cou- 
pling. In this study changes made to the source code of the UNIX oper- 
ating system were used in the validation effort. A strong correlation 
was found between the complexity measures and the occurrence of changes. 
Because the major elements of information flow analysis can be deter- 
mined at design time, this model can be used early in the developmental 
process to produce a qualitative evaluation useful in identifying vari- 
ous types of structural flaws in the design and implementation. An ov- 
erview of their work and findings which are applicable to the HAL/S 
software analysis are presented in Appendix C. 

Thayer, Lipow and Nelson’* report on a software reliability study per- 
formed b’ TRW Systems and Energy for the Rome Air Development Center. 
The da ., principally error data collected from four software develop- 
ment projects, was analyzed to study various types of errors in soft- 
ware, the effectiveness of the development and test strategies in pre- 
venting errors and the reliability of the software itself. Their final 
report provides guidelines for data collection and analysis on other si- 
milar projects. Of particular interest in the HAL/S software study are 
the categorization schemes for software errors which were developed as a 
7art of the iRW effort. Based on detailed study of error data from four 
large so'” ware projects they developed 16^ error categories under 16 
tieadip.gs. These categories are highlighted in Table 1. They concluded 
fr'"' ;neir research that errors must be categorized in considerable de- 
tail to be cf practical use in developing or evaluating tools. While 
che msi- categories tend to be the same for different projects, they 
found that the appropriate detailed categories depend on the operating 
environment characteristics, the language being used and the development 
strategy. 
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TABLE 1 


Major Categories of Errors 


Computational errors 

result from errors in coded equations 
Logic errors 

errors in logical processing 
Input/output errors 

errors from i/o code rather than from interface 
Data handling errors 

errors in reading, writing, moving, storing 
and modifying data 

Operating system, system support errors 

errors in OS, compiler, assembler, system support 
software and system utilities 
Configuration errors 

catastrophic problems encountered when the 
software failed to be compatible with the 
system software 
Interface errors 

routine/routine interface errors 
routine/system software interface errors 
Tape processing interface errors 
user interface errors 
database interface errors 
User requested changes 

user category for enhancements and requested changes 
Preset database errors 

preset data primarily initialization data 
Global var iable/compool definition errors 

errors in global variables or constants 
Recurrent errors 

reopened error previously categorized 
Documentation errors 
Requirements compliance errors 

software not compliant with specification 
Unidentified errors 

errors with insufficient information to classify 
Operator errors 

problem due to operator, developer or tester 
Questions 

error report to record a question needing to be answered 
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2.2 DEFINITION AREA 


The first steps accomplished by TAHU in the analysis of the space shut~ 
tie software were of an investigative nature. Many areas needed to be 
defined and an inventory taken of what information and data was availa~ 
ble in the areas to be studied. 

The goal in the documentation area was to determine what documentation 
was available during the development of the Flight Software for the 
Shuttle. The Research team received several boxes of manuals and do- 
cuments. Inventorying the manuals received was one of the first steps 
in the project. Though many of the manuals received were duplicates, 
the list in Appendix A provided the research group with an outline of 
what types of information was available. The next step in the documen- 
tation area was to determine the structure of the documents and manuals 
for both NASA and IBM as described in Section 2.2.1. 

The cost area was also an area of study. Defining this area proved to 
be quite difficult. Though the document Space Shuttle Orbiter Software 
Management Plan , produced by IBM stated that the Cost and Scheduling in- 
formation was kept in machine readable form, the project team was re- 
peatedly pointed toward the NASA 533 monthly reports. 

An investigation of the DR/CR procedures and how the DR/CRs affected the 
development of the software was also part of the definition area of this 
project. The primary source of this study was the Space Shuttle Orbiter 
Avionics Management Plan . From this document the different code and de- 
sign inspection steps were defined to the project team. At this step 
the team could better understand the flow of the DRs and CRs . It also 
became evident that trying to relate the DR and CR information to cost 
would be an interesting task. 


2.2.1 List of Documentation 

Determining the overall picture of the documents on the NASA side of the 
picture was a relatively simple task. Many of the NASA documents con- 
tained a Preface stating the design philosophy and the structure of the 
specifications. Also, contained in the Preface was a list of Level A 
and Level B documents. However a list of Level C or detail design docu- 
ments was not so readily found. After a little investigation, a list of 
the Level C documents was found in the NASA document entitled "Statement 
of Work" dated July 25, 1980. 

Putting the IBM side of the documentation together was not as easily 
done as the NASA side. After searching all available documents, the 
structure was uncovered in a manual with the wrong cover page. The ma- 
nual dated 2/25/77 had erroneously been labeled Vol III - Applications: 
Guidance, Navigation, and Control instead of Vol I - Software Systems 
Overview. However, this manual did relate the NASA requirements to the 



detailed design specif icatons written by IBH and used by the prograaming 
teams . 


2.2.2 Cost Data 

The area of time management and development manpower control appeared to 
be an area of interest and one which some useful information could be 
gleaned. This area, however, proved to be relatively difficult because 
of the lack of detailed information and the changes of reporting poli- 
cies which took place during shuttle software development. 

The source of information for the cost of the project was the monthly 
reports which IBM prepared for NASA. Since these were provided to the 
TAHU research team as copies of the reports, the information had to be 
coded and reentered into machine readable form. The major problem in 
analyzing information in these reports was the changes in NASA's report- 
ing requirements. The reports changed in April of 1980 from man-equiva- 
lents as a measure to the use of hours. This necessitated >.he data be- 
ing converted to a common format for man-time. At the same time, the 
categories of shuttle function reported in development also changed. In 
September of 1981, the report formats changed again both in categories 
reported and the measure of man-time reported. 

The changes in categories of shuttle function was the major problem. 
These changes made it difficult to track the cost of the major functions 
of the Shuttle Software and made any sort of analysis in that area dif- 
ficult. 

The cost data were plotted over time. Examining the development and 
verification costs per month. Figure 2 (all figures will be found in Ap- 
pendix M) , notice that development costs show three phases: pre-May, 
1980; May, 1980 through July, 1981; and post July, 1981. These may 
coincide with major missions. Verification costs, however, do not show 
this trend Figure (3). Verification costs increase to a level attained 
in late 1979 and then oscillate at this level thereafter. 

Focusing on cumulative costs for development. Figure d, and verifica- 
tion, Figure 5, the rate of expenditure has not changed significantly 
over the study period. The slopes of the cumulative curves have not de- 
creased significantly, indicating that the rate of development and veri- 
fication are the same throughout the study period and did not level off 
during the period under study. 
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2.2.3 Cost Data Rel gted to CR ' s and DR ' s 

Cost data were studied in relation to the number of DR's and CR's. 
Methods involved were graphical comparison and correlation analysis. 
The number of DR's and CR's were examined on the same axes as develop- 
ment and verification costs. Figure 6, Appendix H, shows the cost and 
change data (scaled by 20) together. Note that there appears to be no 
direct pattern across the variables. 

The apparent lack of direct correlation between costs and number of 
changes per month was confirmed by subjecting the data to correlation 
analysis. Spearman nonparametric correlation coefficients, Table 2, 
show that development costs were related to the number of CR's, verifi- 
cation costs, and cumulative development and verification costs. Devel- 
opment costs were not related to the number of DR's for that month, but 
to the number of DR's 6 to 12 months prior. This would seem to indicate 
a mechanism of change data feedback into development, with a 6 to 12 
month lag period. 

Verification costs did not correlate with the number of DR's or CR's for 
that month. The number of DR's entered 7 to 12 months prior, and the 
number of CR's entered 8 to 12 "''nths prior were significantly correlat- 
ed with verification costs. Apparently there is about a one half year 
period required for the changes to work through the system. 

Verification costs did correlate with development costs and cumulative 
aevelopment and verification costs. 
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Hain 

Correlated 



r Significance 

Variable* 

Variable* 




Level 

devel 

ever 



-.76 

<.001 


edevel 



-.69 

<.001 


erlagl2 



.44 

.001 


erlagl 



.43 

.002 


ver 



-.40 

.005 


drlagl2 



-.40 

.005 


drlagll 



-.39 

.005 


drlaglO 



-.34 

.02 


crlaglO 



-.32 

.02 


erlagll 



-.31 

.03 


numcr 



.30 

.03 


drlag9 



-.28 

.05 


erlag2 



.28 

.05 


crlagS 



.28 

.05 


drlag6 



-.28 

.05 

ver 

cdevel 



.61 

<.001 


ever 



.61 

<.001 


erlagll 



.i8 

<.001 


crlagl2 



.49 

<.001 


drlagl2 



.44 

.002 


devel 



-.40 

.005 


dr lag? 



.40 

.005 


drlagll 



.36 

.01 


drlag9 



.35 

.02 


drlaglO 



.35 

.02 


drlagS 



.34 

.02 

» 


crlag9 



.33 

.02 


crlaglO 



.31 

.03 


crlag8 



.30 

.04 

* devel 

~ development costs 





cdevel 

•= cumulative development 

costs 


ver 

“ verification cost 





ever 

■ cumulative verification costs 


numcr 

“ number of CR's for 

a month 



numdr 

“ number of DR's for 

a month 



crlagX 

“ number of CR's for 

the 

Xth 

month previous 


drlagX 

• number of DR's for 

the 

Xth 

month previous 
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2 . 3 CODE AREA 


The objective of the Code Area effort was to decompose the Space Shuttle 
Orbiter Software into a data format that facilitated statistical gather- 
ing procedures. This effort proceded in two directions: 

1. data generation from available HAL/S utilities. 

2. data generation from proposed source code analyzer or scanner. 

Installation of the HAL/S utilities required a familiarization with the 
HAL/S 360 System and then testing procedures with data that was provid- 
ed. The development of the software analyzei.' required a working know- 
ledge of the HAL/S language, a formulation of the complexity factors for 
the HAL/S language, and a design for a generalized statistical data for- 
mat . 


2.3.1 Availability of Source Data 

In order to analyze the Space Shuttle Orbiter Software for the proposed 
statistical model, a collection of software releases from one time per- 
iod to a later time period was required. For this particular project 
only one software build or release was studied. Initially, a version of 
Release 16 of the Flight Software was to be the subject of this study. 
After receiving the first group of tapes for Release 16 from NASA, it 
was found that most of the data for Release 16 could not be read from 
tape. The tape reading problems were caused by incorrect label informa- 
tion and bad or missing tape file marks. The earliest available com- 
plete release of software on tape from NASA that could be used for ana- 
lysis was Release 19.2. This release was the final or deliverable 
software from IBM i.u NASA and was used to fly the Space Shuttle Orbiter. 
The data on the tapes from NASA for this release contained: 

1. FSW 19.2 

a) Application source libraries 

b) System source libraries 

c) Include source libraries 

2. Simulation Data Files (SDF's) for the AP-101 

3. Load modules for OS/360 

4. HAL/S 360 Compiler 


a) HALSTAT 



b) Linkage Editor Utilities. 


Data which were unavailable from IBM were the OS/360 SDF's and the build 
information for Release 19.2 . In talking with IBM representatives, it 
was found that the OS/360 version of the SDF's were not kept up~to~date 
as the software release progressed into its final stages. Also, there 
was no documentation on how to reconstruct the build from the source 
members on tape. The unavailability of the OS/360 SDF'S and the build 
information for Release 19.2 presented problems which will be discussed 
in later sections. 


2.3.2 Documentation of HAL/S 

In order to analyze a program for factors relating to complexity and re- 
liability, a good understanding of the native language is necessary. 
For the purpose of learning about HAL/S, three particular references 
were found to be useful. They were: HAL/S Language Specification 
(IR-542) , Programming in HAL/S (Intermetrics), and HAL/S Programmer ' s 
Guide (lR-63-5) . 

With the intention of using some of the statistics generated by the 
utility HALSTAT, the installation of the HAL/S language compiler as well 
as HALSTAT became necessary. The HAL/S 360 Compiler had to be installed 
to provide the OS/360 SDF's for input to HALSTAT. More detail will be 
given concerning the reason for installation of the compiler in subse- 
quent sections. Most of the information required for installation was 
f iven in HAL/S-360 User ' s Manual (lR-360-2) . Implementation of the 
HALSTAT utility was aided by use of the HALSTAT User ' s Manual (IR-349) 
which contained helpful program and JCL examples. 

During the uiivelopment of the source analyzer program, the HAL/S Lan - 
guage Specification manual was referenced frequently concerning details 
of the HAL/S syntax. The concepts of automated code analysis and subse- 
quent reliability measurements were derived from a dissertation by Jean 
C. Zolnowski^'' entitled: "A System for Measuring Program Complexity" and 
are given in Appendix D. 


2.3.3 Methodology of Analysis of Source Data 

As mentioned preyiously, the methods of analyzing the Space Shuttle Or- 
biter Software inyolved the use of the HAL/S utilities and development 
of a source code analyzer. The HAL/S utilities used to gather statis- 
tics from the Flight Software were HALSTAT and the HAL/S 360 Compiler. 
The HAL/S 360 Compiler provided the SDF input to HALSTAT which generated 
formatted reports on load module statistic.^. The source analyzer was 
designed to ui e the uncompiled version of tlie source and produce output 
which could be analyzed in various formats through the Statistical Ana- 
lysis Systcjm (SAS) or other statistical software systems. 

- 11 - 


1 



The initallation of HALSTAT and the HAL/S 360 Compiler was finished far 
ahead of the final design work for the source scanner. Therefore a com- 
plete rdview of what HALSTAT could provide in the way of program com- 
plexity statistics was available. This allowed a decision to be made 
whether to continue in the HALSTAT direction or the source analyzer di- 
rection for gathering complexity statistics. The decision was based on 
the ease of using each method as well as the detail of statistics gener- 
ated by each method. After careful consideration, it was decided to put 
the major emphasis on developing the source analyzer for the following 
reasons : 

1. The number of source members that had to be compiled in order to 
provide HALST.^T with SDF inputs was considerably la* 

2. The problems encountered when compiling the FSW e members 

made the input preparation step to HALSTAT difficult 

3. HALSTAT was lacking in production of complexity statistics relat- 
ing to imbeddedness , nesting levels of certain constructs, and 
connectivity information. 

A. The frequency count information given by HALSTAT only applied to 
certain types of instructions. For frequency counts on other ca- 
tegories of complexity factors, such as the number of references 
for a particular variable or the number of I/O instructions, 
either a complex prog."ss Lad to be devised to gather and tabulate 
these statistics from the HALSTAT report or these statistics had 
to be hand-tabulated from the report. 

More details for the decision to concentrate the effort toward the 
source code analyzer will be discussed in the following sections. 

It was noted that the effort toward using HALSTAT was not wasted while 
attempting to locate or generate a tool to provide program complexity 
statistics. The complexity statistics which were missing from HALSTAT 
and the difficulty in using HALSTAT provided a set of design require- 
ments for the source code analyzer. Two examples of the requirments 
were that the source code analyzer would have to provide an output re- 
cord with a broad definition to cover all areas of complexity analysis 
and that only the uncompiled source code would be analyzed. SAS or spe- 
cial post-processing programs will be used to group, tabulate, and cate- 
gorize the ouput source code analysis data from the individual FSW 
source members. 


2.3.3. 1 Size of Data 

The Flight Software (Rel 19.2) is subdivided into three main libraries: 


1. System source 



r tk 


r 

a) Of the 350 modules that comprise the system source, approxi- 
mately half are written in AP-101 assembler, and the remaining 

are written in HAL/S. There are about 100,000 lines of source 
code in the system library. 

b) Many of the system modules 'include' other system source mo- 
dules. 

c) The list of modules in the System source library is c^'iitained 
in Appendix H. 

2. Application source ^ 

a) The application source was written in HAL/S and consists of 

985 modules. It contains a total cf 385,000 lines of code. 

b) The typical application module 'includes' o^her system and ap- 
plication source modules. / 

c) The list of modules in the Application source library is con- ^ 

tained in Appendix F. 

3. Include source 

a) There are 673 Include modules which were written in HAL/S. 

They contain 200,000 lines of source code. 

b) All Include modules are self-contained (no 'includes' of other 

modules). ' 

c) The list of modules in the Include source library is contained 
in Appendix G. 


2. 3. 3. 2 FSW Source Compilation 

Initially the HAL/S 360 Compiler was installed to expa.id the FSW source 
code. This source expansion meant that all external souice code sec- 
tions (SDF's or compiler templates) of the source member being analyzed 
would have their reference and interface sections listed in the compiler 
output; that is, an external COHPOOL would have its header statement and 
data definition statements listed, an external PROCEDURE cr ''UNCTIOM 
would have its header statement and data definition statements for its 
formal parameters listed, and an external PROGRAM would have only its 
header statement listed. From this expanded source listing, the source 
code analyzer would have an input that provided external reference and 
interface information. This external information is necessary to give 
accurate statistics regarding for example Che number of va.-iables of a 
particular data type (ARRAY, VECTOR, MATRIX, STRUCTURE etc.,) which are 
encountered in a particular operation (addition, subtraction, division. 
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etc.,). In the case of an external variable that is of VECTOR type, its 
use for a particular operation in the source member being analyzed could 
be that of a SCALAR or VECTOR variable. This multi-use attribute also 
applies to external variables of the ARRAY, MATRIX, and STRUCTURE 
types. Therefore the type of an external variable has to be known. 

Another reason for the HAL/S 360 Compiler installation was to generate 
360 SDF's as input to HALSTAT. In the data received from NASA, O/S 360 
load modules were supplied along with AP-101 SDF's. The inputs required 
by HALSTAT have to be generated from the same machine types. Also the 
compiled versions of the SDF's must match the version of the load module 
they are being used with. Since IBM did not keep or deliver the up-to- 
date 0/S 360 SDF's to NASA, it was again necessary to install the HAL/S 
360 Compile to reproduce the SDF's. 

The first compilation experiments performed by the Code Group uncovered 
the restriction that a specific compilation order for all of the FSW 
source members must be followed. The INCLUDE statement is the compiler 
directive used to bring in the SDF or template that is included in the 
source member. If one source member included several external code 
units (SDF's or compiler templates), then these external code units had 
to be precompiled with their SD*^'s or templates stored in appropriate 
libraries used by the HAL/S 360 Compiler. These INCLUDED external code 
units could also iiiclude other external code units within their units; 
and so on, with no limit for the nesting of INCLUDE statements. The 
only way to determine the comnilation order was to bring each source 
member onto a scree** editor and record its INCLUDE list. After the mas- 
ter list was produced, the compilation order could be determined by 
brt^king the list into compilation passes consisting of those members 
having no external units, having only one external unit, having two ex- 
ternal units, etc., the process repeating until all the FSW source mem- 
bers were compiled. This method was confirmed by IBM as being the only 
practical way of determining the compilation order. IBM could not pro- 
vide TAMU with the compilation order. 

The process of recording the master INCLUDE list of the FSW source mem- 
bers took approximately one month of work for three people. The first 
and second compilation passes could be easily derived from the master 
list, but the third and succeeding passes required considerably more 
effort. The first compilation pass consisted mainly of COMPOOL source 
members while the second compilation pass consisted mainly of interface 
routines to the COMPOOL source members. The more complex compilation 
units (PROGRAMS) could not be easily compiled, allowing only 75*4 of the 
FSW source code to be expanded and compiled for SDF's. Because of the 
time constraints involved with the project, it was determined that the 
best method of analysis would be one that did not involve any compiling. 
This decision placed the analysis effort using HALSTAT at a standstill 
until the 0/S 360 SDF's for the 0/S 360 load modules could be more easi- 
ly obtained. 
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2 . 3 . 3. 3 


Overlay or Build Sequence 


Concomitant to the compilation order problems, the documentation needed 
to build a phase of the Space Shuttle Orbiter Software was not provided. 
By examining the FSW source code only, a source code member could not 
be distinguished as an overlay or a root segment, nor could it be asso- 
ciated to any particular compilation phase. A load module consisting 
of a particular phase build was provided in the data from NASA. The 
load module was in AP-101 format which made the associated segment names 
and structure of the load module difficult to obtain. Information re- 
garding the building of the many other phases was not provided. This 
missing documentation limits tne source code analysis to a static mode. 
In other words, a system, comprising of all source members INCLUDING 
each other, is the largest unit of complexity analysis that can be done. 
If the build information were available, complexity analysis could be 
done in a dynamic mode (complexity anclysis per phase). 




2. 3. 3. 4 HALSTAT 

The documentation received about the utility HALSTAT suggested that it 
could provide much of the analytical information sought in the Code Ares 
effort. Specifically, HALSTAT provides compilation statistics, a memory 
map of the output object module, and a Global Symbol Directory (GSD) . 
The Code Group wanted to determine exactly how useful HALSTAT was in 
collecting factors of complexity and reliability of any particular 
HAL/S source member. 


After examining the output from several HALSTAT runs, it was found that 
some complexity statistics were provided by HALSTAT but others were 
either not provided or could not be derived easily from the HALSTAT out- 
put. A compilation statistic that was useful to this project's source 
code analysis was the frequency count by instruction type (such as how 
many IP's, DO's, SCHEDULE'S, etc.,). Questions concerning the frequency 
count of SCHEDULE statements with cyclic (REPEAT) clauses or the total 
number of real-time statements would have to be hand-tabulated or col- 
lected using a post-processor program on the HALSTAT output. The memory 
map produced by HALSTAT was useful only for purposes of determining the 
memory size required for a source member. The Global Symbol Directory 
did provide useful data on the external and internal symbol reference 
information, but statistics regarding how many times a particular varia- 
ble was referenced and the scope of the variable were not listed. Some 
statistics that were not provided by HALSTAT were: 

1. the nesting level of subprograms and arguments to subprograms 


2. the number of paramters to a subprogram 

3. the number of VECTOR, MATRIX, or ARRAY shaping operations 
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A. the length and nesting levels of IF and DO statements. 

For a complete list of complexity factors to be used in the software 
analysis for this project refer to Appendix D. 

As a result of HALSTAT's incompleteness in providing all of the complex- 
ity statistics and the previously mentioned compilation problems, it was 
decided that the effort towards using HALSTAT as a complexity tool 
should be delayed until more work on the source code analyzer had been 
done. If the source code analyzer could provide all the complexity sta- 
tistics with less operating set-up than HALSTAT, then in all probability 
the incorporation of HALSTAT as a tool would be cancelled. Of course 
this decision cannot be made until the results from the source code ana- 
lyzer are done and its operating procedures are compared with those of 
using HALSTAT. 


2.3. A Source Code Analyzer 

The primary objective of the source code analyzer or scanner is to pro- 
duce daca from which measures of complexity and reliability can easily 
be made. The scanner is designed to output all language constructs of a 
source member to a dataset that will later be processed by SAS (Statis- 
tical Analysis System software) routines. These SAS routines will be 
able to generate all the complexity statistics listed in Appendix D. 
The output format of the scanner was designed to be as accomodating as 
possible for implementation as a SAS input dataset. This was done by 
including appropriate tag and tabulation fields in the scanner output 
record. By merging scar output datasets together through SAS, com- 
plexity statistics at al. .^els of program structure (system, subsys- 
tem, module) can be analyzed. Complexity statistics can even be gath- 
ered at the programmer level by associating, through SAS, the scanner 
output datasets with the INVENTRY file provided by NASA. The INVENTRY 
file contains the programmer's name for each source member. An applica- 
tion example would be to analyze particular software production groups, 
with respect to reliability and complexity, and rank each of the groups 
according to the results. In general, the scanner program can provide a 
statistical data format that can be used as input for a wide range of 
software studies. 


2.3. A. 1 Status of Scanner 

The HAL/S source scanner has been designed according to the structure 
shown in Appendix E (Figure 1). SNOBOL will be used in programming the 
scanner because of its pattern matching and string handling capabili- 
ties. Of the modules shown in Appendix E, only pa*ts of the Variable 
Handler have not been written. The Expression Handler contains the lo- 
gic that operates on any form of syntactical expression. This module is 
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the most compltx and largest piece of code of the »odu*es within the 
Variable Handler. Ti other nodules are currently being tested in an 
isolated mode as well as a connected mode. 


2. 3. 4. 2 Definition of Scanner Record 

The HAL/S source scanner record is comprised of record fields which pro- 
vide informal. on regarding a language construct's locality, type, inbed- 
dedness, connectivity, and identification. As shown in Appendix B, the 
BLOCK NAME and LINE NUMBER fields provide locality information. BLOCK 
NEST LEVEL. STATEMENT NEST LEVEL. EXPRESSION LEVEL. SUBSCRIPT LEVEL, and 
ARGUMENT LEVEL fields provide imbeddedness information. The STATEMENT 
and DESCRIPTION fields provide identification information while the 
SUBDESCRIPTION and ATTRIBUTES fields provide connectivity and type in- 
formation respectively. 

As mentioned previously, the scanner output record was designed to pro- 
vide a format in which all complexity statistics could be gathered. Ev- 
ery HAL/S language construct is classified according to either one of 
four record types: 




1. comment 

2. statement 

3. operator 

4. variable. 

The RECORD TYPE field is a tag field that broadly classifies the lan- 
guage construct. The LINE NUMBER field enables reference data and vari- 
able scope information to be taken since it contains the location within 
the source member where the construct occurred. The FILE MEMBER NAME 
field will be used to obtain complexity statistics, through SAS dataset 
merging, at levels other than the source member level. The BLOCK NAME 
field provides locality data at the block level for a language con- 
struct. It also allows statistics to be taken at the subprogram level. 
The BLOCK NEST LEVEL, STATEMENT NEST LEVEL, SUBSCRIPT LEVEL, ARGUMENT 
LEVEL, and EXPRESSION LEVEL fields give imbeddedness information. For 
instance, the depths of imbedded subprograms. IF and DO statements, the 
number of subprograms that an argument is passed through on one subpro- 
gram invocation, and the depths of parenthesized expressions such as 
those used for subscript evaluation, will be recorded. These fields 
give data not obtainable through HALSTAT The DESCRIPTION and 

SUBDESCRIPTION fields qualify the language construct by recording such 
items as symbol names and statement subtypes. A variable construct will 
have its name placed in the DESCRIPTION field and its STRUCTURE name in 
the SU6DESCKIPTI0N field if it is of STRUCTURE type. A statement con- 
struct will have any subphrase ( the REPEAT phrase on the SCHEDULE 
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st»t*m«nt , 

information 
dtfined and 


the FOR and WHILE/UNTIL phratat on the DO atatament, ate.,) 
racordad. The ATTRIBUTES fiald idantifias how a variabla ia 
how it ia uaad in a atatamant. 


2. A CHANGES AREA 

Tha goal of the changea area was to analyze information concerning aoft- 
wara changes- The first step toward achieving this goal was determining 
what information was available and documenting that information. The 
available data was then ready to analyze. 


2.A.1 Avai labi 1 i ty of Change Data 

Originally the TAMU research team was given five tapes which ware sup- 
posed to contain data on change reports (CR) , discrepancy reports (DR) 
and program change reports (PCR) . While trying to access this data, it 
was determined that only two of the tapes contained valid information. 
The two good tapes contained the OFT DR data base and the OFT CR data 
base. 


2.4. 1.1 Reliability Data 


Traditional hypothesis-testing techniques may be used as a management 
tool by software developers or software purchasers who wish to insure 
that their packages have some specified reliability level. The condi- 

tions that must be met are: 

1. the existence of independent collections of test data 

2. a way of determining the correctness of processing of these col- 
lections 


3. a way of randomly selecting test data. 

Two basic approaches are av:,ilable. In a fixed sample size test, the 
user decides on the reliability desired. The number of test cases which 
must be examined based upon the acceptance/rejection criteria can then 
be determined. In a sequential test, the desired reliability level is 
again pre~determined, but samples a.-r tested one at a time until an ac- 
cept/reject decision can be made. 


Experiments with a large amount of error data derive rom several sys- 
tems indicate that reliability results derived from these models are 
consistent with actual reliability figures. 
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Most current acceptance procedures are based upon a naive assumption 
that a large program can be exhaustively tested and delivered in an er- 
ror-free condition. Because these expections cannot be fulfilled, the 
manager of a software development project or the purchaser of a software 
product is provided with no quantitive information on which to base an 
acceptance decision and is thus forced to make these decisions based 
mostly on intuition and his own experience in similar situations. These 
models allow one to replace these intuition-based decisions with quanti- 
tatively-based decisions and thus constitute an important contribution 
to the science of management of software development efforts. 

In determining what data was available to apply the models to the 'shut- 
tle avionics software' it was determined that sufficient data was not 
available. The data saved during reliability testing consisted of only 
failures of the software to perform as expected. The application of the 
model requires that results from all test cases be available. 


2. 4. 1.2 DR and CR Data 

Data were supplied for discrepancy reports (DR) and change reports (CR) . 
After overcoming initial problems with reading the data tapes, errors in 
data entry resulted in loss of some data, and made early analyses diffi- 
cult. 

Extensive analysis of the change data was difficult. This was due to no 
CR and incomplete DR variable documentation being supplied with the data 
tapes. Supplemental data was requested. Information returned pertain- 
ing to DR's was prompt and complete. However, our request for informa- 
tion on the CR data was long outstanding, and incompletely answered. 
This resulted in the DR data base being analyzed in greater depth. 


2. A. 1.3 DR and CR Legends 

Initially, the documentation for the tape containing the DR data base 
consisted of a variable list and a legend. This DR legend was in the 
first file of the DR data base tape and was helpful, but incomplete. 
Many of the DR variables were not explained in the legend. These unex- 
plained variables were: Verification Assignment for Special (GA) , Pre- 

Build Assessment Data (PD) , Pre-Build Assessment Reason (PR), T&O Clo- 
sure Code (X) , Verification Status Data (S) , Verification Status Data 
(V) , Future Closure Code (IMP), and Verification Baseline ID (BL) . Sup- 
plemental information concerning these variables was requested and the 
information returned allowed a complete DR legend to be compiled. The 
DR legend appears in Appendix J. 

The initial documentation for the tape containing the CR data base was a 
variable list. A legend for this tape was requested, but none was found 



in existance. A list of the CR variables and data base entries was then 
compiled, and information concerning these was requested. When this in- 
formation was returned a CR legend was written. This CR legend appears 
in Appendix L. 


2.4.2 Methodology of Analysis of Change Data 

The first goal was to transfer the change data from the tapes supplied 
by NASA to the Amdahl located at TAMU. The data were eventually placed 
in a Statistical Analysis System (SAS) data base. 

Analyse? were done in two phases. A descriptive analysis approach was 
first taken to examine what data were present and their usefulness. Ex- 
amination of selected single variables was done to determine which va- 
lues were predominant. This was followed by an indepth analysis examin- 
ing the frequency of several variables concurrently. 

All analyses were done using SAS. Plots and histograms were commonly 
used to display the results. 

Due to the lack of a legend for the CR data, during most of the project, 
attention was focused primarily on the DR data. 


2.4.3 Results of Analysis of Change Data 

The change data base consisted of 29*219 entries, for 14,156 DR's, and 
6,282 entries, for 5331 CR's. Dr data began June, 1975 and extended 
through December, 1981, Appendix N, Figure 7 (all figures, unless other- 
wise noted, are in Appendix N) . 

1. The frequency of dates PR's were received was examined . Figure 7 

shows the data are multimodal, with two prominent trends: Octo- 

ber, 1978 through October, 1979, and January, 1981 through Decem- 
ber, 1981. Data were further scrutinized to explain these 
trends, and will be discussed later. 

2. Frequency for mission identifier (MISSN ID) is shown in Figure 8 
By far, most DR's, 7040, pertained to STS-1 (L) . The next most 
common mission identifiers, STS-2 R18V21 flight system (R) and 
S-2 R17V5 (W) , each had almost 2000 DR's logged. 

3. The most common reporting facility (FAC) war the IBM verification 
personnel (VER) , Figure 9. This facility logged over 8,000 DR's. 
The orbital flight test (OFT) facility entered the next highest 
number, just under 3200. 
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4. The dominant area responsible for a fix (AD) was user interface 
(UI) , Figure 10. Other important areas include FLT computer op- 
erating system (FCOS) , requirements analysis (RA) , and vehicle 
utility (VU). 

5. Priority of the DR was examined, Figure 11. Of the six possible 

values, priority 2 and 5 were most common. Priority 2, desira- 
ble, was specified for almost 15,000 DR's. Priority 5, disposi- 

tioned for no mod or no DR closure, was found for about 7,100 

DR's. Only 435 DR's were given critical priority (1). 

6. Examination of DR status (ST) was done. Figure 12. A status of 
closed was found for over 26,000 DR entries (Status “ C, CC, and 
VX) . The remaining entries were either awaiting verification 
(V), or NASA/SSD (N) approval, or in system test (T) . 

After examining the frequencies of certain single variables, more spe- 
cific information was extracted. This involved analyzing the frequen- 
cies of two variables concurrently. Priority was scrutinized first. 


1 . Priority (P) was examined in relation to date the DR was received 
( ODYRMO) , mission identifier (MISSN ID), and reporting facility 
(FAC) . Figure 13 shows that most of the priority 1 (critical), 
occurred before 1980. Priorities 2 and 5 showed a shift, over 
time, in the number reported each month. Priority 2 was dominant 
before November, 1979. Beginning January, 1981, priority 5 was 
the mode. 1980 appeared to oe a period with equal numbers of 
levels 2 and 5 priority DR's. Greater resolution of the frequen- 
cy of DR's logged in per month, by priority, is given in Figures 

14-19. 

Results of examination of priority for a mission identifier are 
shown in Figure 20. The dominance of priorities 2 and 5 is 
clearly evident. Closer examination, by mission identifier, 
shows that priorities 2 and 5 did not occur together in great 
numbers. Only for MISSN_ID L and W did the two occur in abun- 
dance together. This would indicate that a particular mission 
was either relatively absent of real errors, or had many. 

The priority of DR's originating from a reporting facility was 
analyzed. Figure 21 reveals which facilities generate the most 
DR's of a given priority and the relative abundance of priorities 
generated by that facility. Most priority 2 DR's originated from 
guidance, navigation, and control (GNC) , orbital flight test 
(OFT), software development laboratory (SDL), and IBM verifica- 
tion personnel (VER) . Most priority 5 DR's originated from re- 
quirements analysis (RA) and IBM verification personnel. Only 
for the IBM verification personnel facility did the number of 
priority 5 DR's approximate the number of priority 1 and 2 DR's. 
A closer view of the number of DR's from a facility, per priori- 
ty, is given in Figures 22-27. 
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2. Reaults of examining the number of DR'i generated per aiision 
identifier, are given in Figures 28”57. These figures reflect 
two items, the lack of complete documentation and the length of 
time that mission was developed. Figure 28 displays the number 
of DR's with missing mission identifiers, 4408 in all. 

Several patterns in the frequency per mission, over time, are ev- 
ident. Most missions have DR's extending over a period of one 
year or less, for example C (Figure 31), G (Figure 35), and H 
(Figure 36) . However, some missions had entries extending over 
several years; missions L, M, and W are examples. Each one of 
the latter displayed a different frequency pattern. Mission L, 
STS-1 FUP5 (Figure 38), shows a multimodal distribution, skewed 
towards the earlier dates. This is reasonable because the DR's 
should decline to acceptable levels before the shuttle flight. 
Mission M, STS~1 FUP4 (Figure 39) , has a more unimodal trend. In 
contrast, mission W, STS-2 (Figure 54), has a distinct multimodal 
distribution over its 35 month span. This multimodality is pro- 
bably due to multiple releases pertaining to it. 

3. Four groups of similar releases were examined to determine if the 
number of PR's generated per release declined as the release ord - 
er increased. Figures 58-61. Three of the groups displayed this 
trend. However, mission_id S7, SDL release 37, showed an in- 
crease of 13 percent over mission id S6, SDL release 36, Figure 
60. 


Examination of CR variables was minimal due to the lack of information 
available about the variables. 

1. Data pertaining to manpower impact were plotted : manpower impact 

by department and year (D1IMPYR1-D7IMPYR4) , Figures 62-88 and to- 
tal manpower impact by department (D1T0TIMP-D7T0TIMP) , Figures 
89~95. Manpower impacts by year and department all showed a si- 
milar pattern with modes of 15 units or less. Exceptions are de- 
partment 6, year 3 (Figure 84) and department 7, year 3 (Figure 
87); both had impacts which did not exceed one. Department 7, 
year 2 had no observations. 

Maximum values for total manpower impact ranged from 18 for de- 
partment 6 (Figure 94) to 42000 for department 5 (Figure 93) . 
Midpoints of the modes for each department was zero, indicating 
that most CR's had small impact values. 

The significance of these data is not understood because of the 
lack of information supplied by NASA and IBM. 

2 . The amount of time a DR or CR took to get to a particular stage 
in the change process was studied. The number of months needed 
for a DR's development close date (BD) and verification close 
date (VC) was determined. Figure 96 shows that DR development 
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close date was essentially the month it was entered. The 
verification close date, on the other hand, did take up to four 
years, with a majority of DR's closed in 18 months, Figure 97. 

The amount of time a CR took to get dispositioned by the RR and 
OASC boards was examined. CR's were dispositioned by the RR 
board within 24 months, and most within 2 months after being re~ 
ceived. Figure 98. CR's which required an OASC board disposition 
were processed within 20 months, with a majority within two 
months. Figure 99. A similar plot resulted when examining the 
amount of time a CR took to get from a RR board to a OASC board 
dispostion, Figure 100. 


2.5 SUMMARY OF DATA AVAILABILITY 

Table 3 is a summary of the availablility of data found by the research 
team in examining the shuttle software development. Data is coded as 
having been found in machine readable form or in hard copy form. The 
data found to be available is also coded as to whether the research team 
found the data beneficial in extracting useful information. 
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FUTURE WORK 


The data which has been collected tc date in the shuttle software devel- 
opment provides a wealth of information about the life cycle of large, 
real-time programs. This type of data is often not available to compu- 
ter researchers, particularly data for the development of real-time 
software. Several studies have begun at Texas A&M using the available 
shuttle data and can be beneficially continued. These projects are out- 
lined in section 3.1. As a result of our study of the available data we 
have identified certain analysis and data collection monitoring func- 
tions (presented in section 3.2) which could be performed at Texas A&H 
concurrent with cn-going software development at JSC. Section 3.3 high- 
lights additional projects which we have identified as appropriate for 
future work. Some of these future projects will necessitate the collec- 
tion of additional data during future shuttle software development. 


3.1 CONTINUED ANALYSIS 

3.1.1 Continued Development of Cost Data 

All the cost data from the monthly 533 reports which are prepared by IBM 
have been encoded and analyzed as described. The research team has been 
informed that more detailed documents below the 533 level exist and can 
^e made available. These documents could provide some very interesting 
results once codec and analyzed. 


3.1.2 Continued Work with Language Scannr 

The continuation of work invo'ving the HAL/S source analyzer will be 
comprised of three areas. First, the coding and initial testing of the 
source analyzer will be completed. Next the SAS procedures to analyze 
the source scanner output will be developed. Finally, statistics will 
be grouped concerning subsystem and system levels of the Flight Software 
specifically regarding elements of the language used, programming style, 
and complexity ranking. 

In the initial testing phase of the scanner project, each test run will 
contain the output for one source member. Since the scanner is designed 
to analyze the uncompiled source, several runs may have to be made for 
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the external members INCLUDED in the source member being processed. The 
raw scanner output data will be checked for correctness and frequency 
count statistics will be tabulated from it. It may be possible for some 
source members to be compiled and used as input to HALSTat for a listing 
that can be used for verifying the results from the raw scanner output 
data. 

After the scanner has been debugged and its results verified, the scan- 
ner will be run against each FSW HAL/S source member. Those source mem- 
bers that are composed of AP-101 Assembler code, will have HAL/S Compi- 
ler templates written to be analyzed. Thes. source members are mainly 
located in the System Source Library. Instruction mix and variable re- 
ference data from the AP-101 modules will not be available from the com- 
piler templates, but connectivity information will be preserved. Later 
work will be done to design a similar type scanner to analyze the AP-jOl 
Assembler modules to provide the instruction mix and variable reference 
data temporarily unobtainable. All output from each source member will 
be stored on tape with the FILE MEMBER NAME field of the output scanner 
record identifying the particular source member. 

When the scanner has been run against all the FSW source members, some 
simple SAS routines will be run against the scanner output for one 
source member. These initial SAS routines will report on the number of 
instructions occuring by type, variables occuring by common attributes, 
and other statistics that can be drawn from frequency count methods. 
Once again, HALSTAT may be used as a tool for verifying the SAS results. 
More complex SAS routines will be written later to output variable 
scope, IF and DO nesting level, and subprogram argument nesting level 
information at the source member level. 

After all complexity statistics are generated from each source member, 
the SAS output datasets can be sorted and merged to provide complexity 
statistics at the subsystem/system level. For example, statistics can 
be produced for the set of modules comprising the Process Control sec- 
tion of the Process Management subsystem of the Flight Computer Operat- 
ing System. It will be pOLsible to generate complexity statistics at 
the programmer level by merging the previously mentioned INVENTRY file 
with the SAS output datasets. If it is known what source members were 
written by a particular programmer (information which the INVENTRY file 
provides), then these statistics are possible. If each software produc- 
tion group personnel roster was made available from IBM, then complexity 
statistics could be obtained at the software production group level. 

Using the complexity results from SAS, it will be possible to determine 
which of the HAL/S complexity factors listed in Appendix C should be 
used as guides in ranking the FSW source modules in regard to complexi- 
ty. The complexity factors that will be chosen as ranking guides will 
be the ones that show a variance within the source modules. Once the 
ranking factors are established, FSW source members, software subsys- 
tems/systems , as well as programmer software collictions can be ranked 
with one another, 
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2.1.3 Continued Analy»ii of CR «nd DR Data 


The analytes of CR and DR data described earlier in this report give 
sooe indication that a neasure of the stage of development (either as 
percent code completed or as number of future changes to be required) 
may be related to characteristics of previous CRs and DRs (e.g., the 
number, mission identifier, reporting facility, priority mix, etc.). It 
is possible that these results may be used to model software quality in 
a manner similar to that proposed by Hendis (1982).^* 

To this stage, the analysis of CR and DR data has eximined two-way rela- 
tionships between date and a characteristic of the CRs and DRs or bet- 
ween two characteristics. Future analyses of CR and DR data should in- 
clude further investigation of the re'ationship between the historical 
CR ana DR data for software devlopment and measures of the reliablity, 
or level of completion, for the software. In particular, multivariate 
relationships for three or more characteristics should be examined. In 
addition to using CR and DR data, information gathered by the FAL/S 
source analyzer and other characteristics such as language used, pro- 
gramming style, etc. may improve the modeling of the stage of develop- 
ment for software. 


3 . 2 CONCURRENT ANALYSIS AND MONITORING 

In order to maintaine a respositry of information about thi development 
of the space shuttle software system, TAMU suggests the following data 
be collected for each release of the space shuttle software. 

1. A copy of all oistribution material made to NASA test facilit'os. 

2. A copy of all source code libraries. 

a) Application source 

b) System source 

c) Include source 

3. A copy of the current version of the HAL/S compiler, HALSTAT, the 
linkage editor, and associated documentation. 

4. A copy of the build information necessary to construct a build 
rrom tne above libraries and execute all options on HALSTAT. 

5. A copy of all cost information. 

6. A copy of the cummulative DR and CR files. 

All of these items should be in machine readable form whenever possible. 
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TAMU would like to serve as a repository of this i.iforaation. 


3.3 FUTURE DEVELOPHENT 

Although many possibilities for future projects and analyses :n the 
shuttle software development effort exist, the TAMU research team has 
identified four related areas for which future work seems particularly 
beneficial. These efforts in general involve the development and/or im- 
plementation of models which can provide input to decision-makers at 
NASA as well as in the computer research community at large. If these 
models are developed in conjunction with the continued and expanded col- 
lection of the shuttle software data as described in the previous sec- 
tions, the model will also provide tools useful in tracking the evolu- 
tion of the development effort. 


3.3.1 Compari.<'On with other Projects 

Future research on the statistical and historical information gathered 
during the development of the shuttle orbiter primary flight software 
can be conducted in several directions. The available data from the 
flight software is from a unique environment, a substantial ongoing 
real-time software project, and thus provides an excellent groundwork 
for reverification, comparison, modeling, and subsequent verification of 
metrics. Comparisons formed on a single large real-time software system 
will be more significant to the computer science community than compari- 
sons formed on small samples of experimental software. For instance, 
most studies that have been made are performed on small data samples 
that are potentially biased, while the few studies performed on larger 
sample sizes differ greatly in the type of errors considered and in the 
data collection techniques utilized. In additio.., although several com- 
plexity models have been proposed in the literature, they have not all 
been verified, and studies attempting to verify proposed mathematical 
models for software reliability models are scarce. 

Several objectives will be obtained by researching the verification and 
reverification of complexity measure and reliability predictor models on 
the space shuttle software. Since they will have a standard software 
basis for comparison, the various metrics can be ranked in regards to 
their effectiveness. After the models are "tuned" statements can be 
made concerning the various types of error predictors/analyzers, such as 
stating that modrls which measure control structure complexities are 
more effective than models which rely on length of code. A more effec- 
tive complexity metric will be developed to pinpoint the areas of great- 
est complexity within a software system, thus providing management with 
a tool to use in allocating various resources such as personnel and time 
when evaluating and making changes to a srftware area of greater «rror 
potential . 
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3.3.2 Complexity Analysis 

Complexity is the term generally used to describe the difficulty in de- 
veloping software or in the software's resistance to modifications.* 
Complexity metrics are designed to measure complexity related to a human 
process — namely, programming — as contrasted with computational com- 
plexity where the area of concern is a machine procedure or machine re- 
source allocation. A number of metrics have already been discussed in 
the survey of literature section of this report ( see section 2.1). 

Complexity analysis of the HAL/S software could be expected to provide 
insight into tne relative quality of the program as a whole and its in- 
dividual components. Such measurements would be useful in estimating 
costs of maintenance and enhancements of existing components. Further- 
more the metrics could be used in decisions to replace or modify sec- 
tions of code. Models based on the complexity metrics could be used in 
estimating the likelihood of errors within each program module. Since 
the space shuttle project is ongoing, the proposed research on complexi- 
ty measures will provide continuous future error prediction to help in 
identifying the locations of potential errors within the project soft- 
ware and some indication of how soon a particular software build (or 
system) will be ready to be utilized. Accordingly, the results obtained 
can also be used for future projects and may help reduce costs by ena- 
bling management to allocate resources more optimally. 

Although a number of models utilizing complexity metrics have been sug- 
gested in the literature, only limited validation of these models has 
been accomplished, often with data from small software projects. Appro- 
priate models could be established and validated using the HAL/S devel- 
opmental data. These models would then be available for use in deci- 
sion-making in future HAL/S implementation efforts. 


3.3.3 Cost Analysis 

For future projects, all cost and hours information should be kept in 
machine readable form. Standard reporting categories should be estab- 
lished and adhered to throughout the project. Further subdivisions of 
categories coulo provioe some flexibility and provide usable detailed 
information. While this data could be consolidated for managerial re- 
porting purposes its detail could provide valuable information for fu- 
tur. analysis. If new categories become needed they could be added to 
satisfy the current requirements. 

The cost impact of DRs and CRs on the software is another area in which 
more information would be useful. The cost or time actually taken to 
dispose of each DR or CR should be kept in machine readable form. 

Some valuable analysis could be done in this area. Statistics could be 
gathered in the total ''osts of DRs and CRs, the total cost of DRs and 
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CRs versus the totsl cost of developenent , the total cost of DRs and 
CRs in one subsytem or function of the shuttle versus another function, 
and perhaps the average tine it takes to correct a DR. 


3.3.4 Language Analysis 

Software developnent at the present state-of-the-art cannot be evaluated 
independently of the programning language employed in its implenenta- 
tion. Although researchers note the need for the development of pre- 
cisely defined universally accepted software evaluation parameters, a 
suitable number of metrics of this type simply do not exist at this 
time.^* Therefore an important area of concern in software evaluation is 
programming languages. 

To facilitate this type of analysis certain language metrics are needed. 
These metrics tend to be more subjective and harder to define than pro- 
gram metrics which are u'^c^d in evaluating the programs written in a lan- 
guage. The primary traditional uses for language metrics are in lan- 
guage selection and/ot comparison and for language design.** 

The existing language metrics could beneficially be applied to HAL/S 
with several useful results. First, since HAL/S was specifically de- 
signed for spacecraft software development, some measure of its effec- 
tiveness could be obtained using language metrics. Since most of the 
existing metrics produce relative measures, the same measurements could 
be computed for other high level languages for the purpose of comparison 
with HAL/S. Of particular interest would be metrics which measure the 
applicability of a language to a specific application. Other metrics of 
interest mi^ht include comparison of the desirability of various lan- 
guage features, comparisons of the level of non-procedural ity of lan- 
guages (since non-procedural implies a lesser need for the programmer to 
specify implementation details), and comparisons of potential programmer 
productivity in each language. 

The new Department of Defense language Ada is the most natural choice 
for a language with which to compare HAL/S. The results of such a com- 
parison would ts useful to NASA in making future language selections. 
In addition, since HAL/S has already been successfully used in large 
real-time software projects while Ada has not, HAL/S rould be considered 
a standard against which Ada could be evaluated. 

The language analysis of HAL/S would utilize existing program metrics at 
well as some designed specifically for this task. If a comparison with 
Ada is desired, a preliminary Ada compiler developed by New York Univer- 
sity under contract with the U. S. Army is available and operational at 
Texas A&N University. 



Appendix A 
DOCUMENTATION 


This Appendix consists of four lists of documents. These lists are as 
follows : 

List 1 - Specifications prepared by NASA 

List 2 - NA:>n documents received by the research team 

List 3 ~ Programs specifications prepared by IBM 

List 4 - IBM documents received by the research team 




NASA Documents 

The Computer Program Development Specification (CPDS) is composed of 4 
volumes which consist of lU books. The following is a breakdown of the 
volumes : 


Vol 

1 

- Level A, Requirements not oriCiited to any 
particular end item, 7 books 


Vol 

2 

- Shuttle Orbiter Software Requirements, Program 
Notes and Waivers 

f 

Vol 

4&5 

- Computer end i tem~v.>x iented functional and 
detail requirements 



The following lists the identifying numbers, volumes, and books that 
constitute the CPDS structure: 


DOCUMENT NO. VOLUME/BOOK 


TITLE 


SS-P-0002-120 I 2 

SS-P-0002-130 3 

SS-P-0002-140 4 

* S5-P-0002-150F 5 


System Level Requirements, 
Software 

ALT Launch Data Bus Software 
Interface Requirements 

Downl ist/Upl ink Software 
Requirements 

OFT Launch Data Bus Software 
Interface Requirements 
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* SS-P-0002-170G 

SS-P-0002-190 

SS-P-0002-195 

SS-P-0002-210 

SS-P-0002-220 

SS-P-0002-410 

SS-P-0002-A20 

SS-P-0002-A30 

SS-P-0002-4A0 

SS-P-0002-450 

* SS-P-0002-510N 
SS-P-0002-515 

* SS-P-0002-530J 

* SS-P-0002-550J 
SS-P-0002-580 
SS-P-0002-590 


7 OFT System Level Requirements, 

Software 

9 ALT Flight Software 

Initialization Load 

9.5 STS Flight Software 

Initialization Load 

II 1 ALT Program Notes and Waivers 

2 OFTIS Program Notes and Waivers 

IV 1 ALT Functional Level Requirements 

GN&C 

2 ALT Detail level Requirements 

GN&C 

3 ALT Functional level Requirements 

Systems Management 

A ALT Detail Level Requirements 

Systems Management 

5 ALT Functional Level Requirements, 

Vehicle Utility and Data Flow-01 

V 1 STS Functional Level Requirements, 

GN&C 

OFT Functional Level Requirements 
GN&C, STS-1 and 2 

3 STS Functional Level Requirements, 

Systems Management 

5 STS Functional Level Requirements, 

Vehicle Utility-02 

8 STS Operations Functional Level 

Requirements, Systems Managent 

9 PASS GPC Memory Write Procedures 



The Level C or Detailed requirements are contained in documents la- 
belled Functional Sub-System Software Requirements (FSSR) . 

These documents are listed below: 
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TITLE 


NUMBER 


GN&C 


Guidance FSSR 


Navigation FSSR 


SD-7A-SH-0272C 
Flight Control FSSR 


SD-74-SH-O27IB 


SD-74-SH-O273 

SD-74-SH-0273A 

SD-74-SH-0273B 

PCN-1 

SD-74-SH-0273C 

SD-74-SH-0272 

SD-74-SH-0272A 

SD-74-SH-0272B 

PCN-1 

SD-74-SH-O27I 

SD-74-SH-0271A 

PCN-1 

PCN-2 


RM/MSC FSSR SD-74-SH-0270 

SD-74-SH-O27OA 

SD-74-SH-O27OB 

PCN-1 

SD-74-0207C 


SOP FSSR 
Prelininary 
Air Data 


SD-74-SH-0269 

PCN-1 

PCN-2 

PCN-3 

PCN-4 

PCN-.5 

PCN-6 

SD-74-SH-0269A 

SD-74-SH-0269B 


Displays and Control 
FSSR 


SD-74-SH-296 

SD-74-SH-296A 

SD-74-SH-296B 

SD-74-SH-296C 


SM CPDS SS-P-0002-440 

SS-P-0002-440A 

SS-P-0002-440B 

SS-P-0002-440C 

SS-P-0002-440D 

SS-P-0002-440E 

SS-P-0002-440F 


- 33 - 



SM FSSR SI>-74-SH-0295 

SD-74-SH-0295B 

SD-74-SH-0295C 

SD-74-SH-0295D 

PCN-1 


Vehicle UtilityOl 

CPDS SS-P-0002-460 

VU-01 FSSR SD-75-SH-0077 

SD-75-SH-0077A 


GN&C, Part A Vol. 2 
Guidance 


SD76-SH-0001C 

PCN-1 

PCN-2 

PCN-3 

PCN-A 




GN&C, Part A Vol. 2 
Guidance-Ascent SD76-SH-0002E 

PCN-1 

PCN-2 

PCN-3 

PCN-4 


GN&C, Part A, Vol. 1 
Guidance-On Orbit SD76”SH-0003B 

PCN-1 

PCN-2 

GNiC Part B,,Nav- SD76-SH-0004D 

Entry + APP A-H PCN-1 

PCN-2 

PCN-3 

PCN-4 


GN&C, Part B, 

Nav-Ascent/RTLS 

+ APP A-N SD-76-SH-0005C 

PCN-1 

PCN-2 

PCN-3 

PCN-A 

GN&C, Part C 

Nav-on Orbit SD76-SH-0006C 

PCN-1 


GN&C, Part C 
FC-Entry 


SD78-SH-0007B 

PCN-1 

PCN-2 
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CN&C, Part C 
FC-Aacent 


STS Baseline is 
in CR 19361 a 


SD76-SH-0008 
Vol 1C 
PCN-1 
PCN-2 
PCN-3 
Vol 2D 
PCN-1 
PCN-2 
PCN-3 


Vol 3C 

PCN-1 

PCN-2 




GN&C, Part C, Vol. 3 
FC 

On Orbit (1) 

On Orbit (2) 


SD-76-SH-009 
REV A 
REV A 
PCN-1 
PCN-2 


GN&C, Part D, Vol. 1 
RM-Entry 


SD-76-SH-0010E 

PCN-1 

PCN-2 


GN&C, Part E, Vol 1 
SOP-IMU 


SD76-SH-0013A 

PCN-1 

PCN-2 

PCN-3 

PCN-A 


GNS.C, Part E 
SOP 

NAVAID 


ST TRK 


SD76-SH70014 
Vol lA 
PCN-1 
PCN-2 
PCN-3 
Vol 2A 
PCN-1 
PCN-2 
PCN-3 


GNS.C, Part E, Vol. 3 
SOP-Sensor/ 
Controller 


SD76-SH-0015B 

PCN-1 

PCN-2 

PCN-3 
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GN&C, Part B, Vol A 

SOP-FC Effectors SD76-SH-0016B 

PCN-1 

PCN-2 

PCN-3 

VU-02 SD76-SH-0019A 

GNiC, VOL. 1 

D&C-Display Formats SD76-SH-0020C 

PCN-1 

PCN-2 

PCN-3 

GN&C 

Sequence Rgmts SD76-SH-0026B 

PCN-1 

PCN-2 


SM 

RMS 

PAYLOAD MANAGEMENT 
GPC INTERFACES 
GPC INTERFACES 


SD76-SH-OO.C.7E 
SD77SH-0002B 
SD78-SH-0044 
S0D76-0002 BK 1 
S0D79-0C02 BK 2 



NASA DOCUMENTS RECEIVED 


FUNCTIONAL DESIGN REQUIREMENTS 


OFT Launch Data Bus Software Interface Requirements- 
(SS-0P-0002-170G) 

OFT System Level Requirements, Software - (SS-P-0002-150F) 
STS Functional Level Requirements, GN&C - (SS~P“0002-510N) 
STS Functional Level Requirements, System Management - 
(SS-P-0002-530J) 

STS Functional Level Requirements, Vehicle Utility-02 - 
(SS-P-0002-550J) 


MANAGEMENT 


Mass Memory Unit Software Integrataion Document and Revisions 
JSC 1674 

Statement of Work Space Shuttle Avionics Orbiter Software ~ 
Schedule II 

JSC - 08338 " Mass Memory Unit Computer Program 
Integration Plan 

Vol. I Release Control 

Vol . I, Book 1 SPF Level A Generic Requirements 

Vol. II Release Authority and Schedule 



Vol. Ill 

Vol. IV, Book 2 

Vol. IV, Book A 
Vol. IV, Book 5 
Appendix C 


Deliverable Requiremente and Tape 
Formats 

Secure Operations Plan 
ADP Security Plan 
Configuration Plan 
Facility Management 
Test and Operations Plans 


JSC 1673 - Software Production Facility Operations 
Document 

SPF Level Generic Requirements 
Configuration Management Plan 
Hardware Configuration Plan 
and Equipment List 

Vol. VI, Book 3 Facility Management 


Vol I, Book 1 
Vol. IV, Book A 
Vol. V, Book 2 




MISCELLANEOUS 


OFTIS - 16 Program Notes and Waivers 
OFTIS - 18 Program Notes and Waivers 
Orbiter Flight Software DR Closures 
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IBM DOCUMENTS 


IBM, in response to the requirenents defined by the NASA and docu- 
mented in the Level A and B Computer Program Developement Specifica- 
tions, developed the System Design Specifications. The System Design 
Specifications is a series of documents consisting of Functional Design 
Specs (FDS) and Detail Design Specs (DOS). 

The list which appears below was taken from a manual dated February 
25, 1977. Therefore, this list might not be as accurate as it could be 
had more recent information been made available. 


Vol. I - Software System Overview 
Forward 

Table of Contents 

1. Introduction 

2. Design Considerations 

3. Functional Description 

A. Flight Software Control Structure 
5. Flight Software Dynamic Structure 
Appendix A - Acronyms and Abbreviations 
Appendix B - Common COMPOOL 

Vol. II - System Services 
Part 1 - FCOS 
Forward 

Table of Contents 
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1. Introduction 




2. Functional Description 

3. Software Design 

3.1 Subsystem Design Overview (Include 
Control Flow Trees) 

3.2 Major Element 1 Overview (includes 
Control Flow Trees) 

3.2.1 Module A 
Function 

a) Control interface 

b) Input Data 

c) Process Description 

d) Output Data 

e) Module References 

f) Module Type and Attributes 

g) Template References 

h) Error Handling 

i) Constraints and Assumptions 
Data tables (Module Data List, I/O) 
SVC Table 

Cojitrol Flow (Preliminary Design) 
Control Flow(s) (Detailed Design) 

3.2.2 Module B 
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3.2.n Module N 


3.3 Major Element 2 Overview (Include* 
Flow Trees) 


3.n Major Element n Overview (Includes 
Flow Trees) 

Part 2 - User Interface 

(Same format as Part 1) 

Part 3 - System Control 

(Same format as Part 1) 

Vol. Ill - Applications 
Part 1 - GN&C 

(Same format as Vol. II, Part 1) 

Part 2 - SM 

(Same format as Vol. II, Part 1) 

Part 3 - VCO 

(Same format as Vol. II, Part 1) 
Part 4 - Payload 

(Same format as Vol. II, Part 1) 

Vol. IV - Summary Integration Specification 

1. Introduction 

2. Process Interaction 


- 


3. Control Block Allocation 



4. Mappings 

5. Critical Parameter Addresses 


6. Downlist Loading 







IBM DOCUMENTS RECEIVED 


FUNCTIONAL DESIGN SPECS 


OFT - Functional Design Specif icatons 


DETAIL DESIGN SPECS 

SDS - Volume III, Part 3, OFT DDS, Vehicle Utility and Data Flow 02 
OFT - System software Designs Specs - User Interface 
FC0S“UI“SC - Design Specs 

SDS Volume III, Part 2 - System Management Design Specs 


USER'S GUIDES 

Flight Computer Operating system User's Guide (18) 
Test and Operations User's Guide (18) 

Shuttle Flight Operations User's Guide (18) 

System Analysis User's Guide ~ User Interface 
UI/SC User's Guide STS-1 
FSW Utilities User's Guide 


MANAGEMENT 

Programming Standards Analysis Procedures 
Programming Standards Document and Updates 
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Complete Software Awareness Memos Update 

Shuttle Avionics Software Avionics STS-1 Operating Plan 

Shuttle Avionics Software Management Plan 

Reliability and Quality Assurance Plan 

Flight Software Memory Sizing and CPU Loading Esicmates 


MANUALS 

AP lOi, C/M Principles of Operation 

SDL - User's Guide for HALSTAT 

Linkage Editor for Flight Computer (partial) 


MISCELLANEOUS 

Space Shuttle Orbiter Avionics Software - STS~3 Flight 
Software Memory Data Base 
Onboard Shuttle Software Design/Code Checklist 



Appendix B 

HAL/S ANALYSIS SCANNER OUTPUT 


Overall Record Description 


Field Description 

# of Chars 

Values 

RECORD TYPE 

2 

CM 

- COMMENT 



ST 

- STATEMENT 



OP 

- OPERATOR 



VR 

- VARIABLE 

LINE NUMBER 

6 

/* 

LINE it OF HAL/S INPUT 

RECORD NUMBER 

8 

/* 

SCANNER OUTPUT RECD // 

FILE MEMBER NAME 

8 

/* 

FILE CONTAINING SRC 

BLOCK NAME 

32 

/* 

PROCEDURE, FUNCTION, 
PROGRAM, ETC., 
SURROUNDING TOKEN */ 

BLOCK NEST LEVEL 

2 

/* 

IMBEDDEDNESS OF BLOCK 

STATEMENT NEST LEVEL 

2 

/* 

IMBEDDEDNESS OF IF 
OR DO CONSTRUCTION 

SUBSCRIPT LEVEL 

2 

/* 

LEVEL OF SUBSCRIPT 

EXPRESSION; 

A$(B$(C))) 

ARGUMENT LEVEL 

2 

/* 

LEVEL OF ARGUMENT 
WITHIN SUBPROGRAM 
INVOCATION 
NAME (NAME (A) ) 

EXPRESSION LEVEL 

2 

/* 

LEVEL OF PARENS 
(A+(B C(E-2))) 

STMT REFERENCE NUMBER 

8 

/* 

COL. 73-80 OF INPUT 

STATEMENT 

20 

/* 

INSTR. KEYWORD 
CONTAINING TOKEN */ 

DESCRIPTION 

AO 

/* 

SEE PARSE EXAMPLES 



ATTRIBUTES 

LETTER CODES */ 


10 /* 

AC 

AL 

AR 

AS 

AU 

BI 

BO 

CH 

CO 

DN 

DP 

DO 

EQ 

EV 

EC 

EX 

FX 

IN 

IP 

IT 

LB 

LT 

LH 

LO 

MA 

MF 

NA 

RA 

RE 

RI 

RH 

RG 

SC 

ST 

SB 

TE 

TP 

VC 

VF 


SEQUENCE OF STORAGE 

- ACCESS 

- ALLIGNED 

- ARRAY 

- ASSIGN USAGE 

- AUTOMATIC 

- BIT 

- BOOLEAN 

- CHARACTER 

- CONSTANT 

- DENSE 

- DEPENDENT 

- DOUBLE 

- EQUATE 

- EVENT 

- EXCLUSIVE 

- EXTERNAL 

- FIXED 

- INITIAL 

- INPUT USAGE 

- INTEGER 

- LABEL 

- LATCHED 

- LEFT HAND = 

- LOCK 

- MATRIX 

- MATRIX FIXED 

- NAME 

- RANGE 

- REMOTE 

- RE INTRANT 

- RIGHT HAND - 

- RIGID 

- SCALAR 

' STRUCTURE 

- SUBSCRIPT USE 

- TEMPLATE 

- TEMPORARY 

- VECTOR 

- VECTOR FIXED 


Total Record length > 138 characters 





/ 


PARSE EXAMPLES 


HAL/S Source: 

C THIS IS A COMMENT LINE 

/* WITH A CR99999 DESCRIPTION AS 
IMBEDDED COMMEHNT */ 

AN 

Scanner Output Reed //I 

Scanner Output Reed if2 

RECD TYPE - CM 

RECD TYPE “ CM 

LINE # ' 000001 

LINE if = 000002 

RECD # = 00000001 

RECD if = 00000002 

BLKNAME = 

BLKNAME - 

BLK NEST LVL = 00 

BLK NEST LVL = 00 

STMT NEST LVL = 00 

STMT NEST LVL = 00 

SRN = 

SRN " 

STMT = COMMENT 

STMT » COMMENT 

DESCR = 

DESCR = CR99999 

ATTRIB = 

ATTRIB » 

HAL/S Source: 

D INCLUDE TEMPLATE APPLTEMP 

D INCLUDE INCLTXT 


Scanner Output Reed //3 

Scanner Output Reed 


RECD TYPE - ST 
LINE # “ 000003 
RECD # - 00000003 
BLKNAME “ 

BLK NEST LVL “ 00 
STMT NEST LVL - 00 
SRN - 

STMT •= INCLUDE 
DESCR •= APPLTEMP 
ATTRIB ' TE 


RECD TYPE - ST 
LINE # “ OOOOOA 
RECD if - OOOOOOOA 
BLKNAME - 
BLK NEST LVL - 00 
STMT NEST LVL - 00 
SRN « 

STMT - INCLUDE 
DESCR - INCLTXT 
ATTRIB - 
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HAL/S Source 


HALSPGM: PROGRAM; 


Scanner Output Reed #5 

RECD TYPE - ST 
LINE # ' 000005 
RECD # * 00000005 
BLKNAME = HALSPGM 
BLKNEST LVL = 01 
STMT NEST LVL = 00 
SRN » 

STMT » PROGRAM 
DESCR - HALSPGM 
ATTRIB = 


- AS - 




* 




Scanner Output Reed 


RECD TYPE - ST 
LINE # ■= 000006 
RECD # - 00000006 
BLKNAME = HALSPGM 
BLK NEST LVL » 01 
STMT NEST LVL = 00 
SRN = 

STMT “ DECLARE 
DESCR - 
ATTRIB = 


Scanner Output Reed 


RECD TYPE = VR 
LINE //f - 000006 
RECD # = 00000008 
BLKNAME = HALSPGM 
BLK NEST LVL = 01 
STMT LVL = 00 
SRN “ 

STMT - DECLARE 
DESCR - SENSOR2 
ATTRIB - ITDO 



RECD TYPE - VR 
LINE y/ - 000006 
RECD # - 00000007 
BLKNAME - HALSPGM 
BLK NEST LVL « 01 
STMT NEST LVL - 00 
SRN ■= 

STMT “ DECLARE 
DESCR = SENSOR 1 
ATTRIB - IT 




i 




HAL/S Source 


CALL ADDSENSOR (SENSORl) ASSIGN (SENSOR2) ; 


Scanner Output Reed 

Scanner Output Reed //lO 

RECD •^yPE - ST 

RECD TYPE - VR 

LINE // - 000007 

LINE // - 000007 

RECD # - 00000009 

RECD # “ 00000010 

BLKNAME - HALSPGM 

BLKNAME "■ HALSPGM 

BLK LVL - 01 

BLK LVL = 01 

STMT LVL - 00 

STMT LVL - 00 

SRN “ 

SRN - 

STMT - CALL 

STMT - CALL 

DESCR - ADDSENSOR 

DESCR - SENSORl 

ATTRIB •’ 

ATTRIB ' IP 


Scanner Output Reed #11 

RECD TYPE •= VR 
LINE # - 000007 
RECD - 00000011 
BLKNAME - HALSFGM 
BLK LVL « 01 
STMT LVL - 00 
SRN - 

STMT - CALL 
DESCR - SENSOR2 
ATTRIB - AS 
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i 




HAL/S Source 


ADDSENSOR: PROCEDURE (SENS 1) ASSIGN (SENS2) EXCLUSIVE; 


Scanner Output Reed jfl2 

RECDTYPE - ST 
LINE # » 000008 
RECD # = 00000012 
BLKNAME » HALSPGM 
BLK LVL - 02 
STMT LVL = 00 
SRN ■= 

STMT - PROCEDURE 
DESCR = ADDSENSOR 
ATTRIB - EC 

Scanner Output Reed //14 

RECD TYPE = VR 
LINE # •= 000008 
RECD // - 0000001 A 
BLKNAME = ADDSENSOR 
BLK LVL - 02 
STMT LVL “ 00 
SRN - 

STMT - PROCEDURE 
DESCR - SENS 2 
ATTRIB « AS 


Scanner Output Reed #13 

RECD TYPE - VR 
LINE # - 000008 
RECD iff - 00000013 
BLKNAME •= ADDSENSOR 
BLK LVL - 02 
STMT LVL “ 00 
SRN = 

STMT - PROCEDURE 
DESCR - SENSl 
ATTRIB - IP 
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HAL/S Source; 


DECLARE INTEGER, SENSl, SENS2 DOUBLE; 

SENS2 - SENS2 + SENSl; COL 73~80 

CLOSE ADDSENSOR; 


Scanner Output Reca #18 

RECD TYPE • ST 
LINE // - 000010 
RECD # - 00000018 
BLK NAME - ADDSENSOR 
BLK LVL “ 02 
STMT LVL » 00 
SRN - COL 73-80 
STMT - ASSIGN 
DESCR “ 

ATTRIB = 

Scanner Output Reed #2 1 

RECD TYPE - VR 
LINE // - 000010 
RECD # - 00000021 
BLK NAME -= ADDSENSOR 
BLK LVL - 02 
STMT LVL = 00 
SRN - COL 73-80 
STMT •= ASSIGN 
DESCR - SENS2 


Scanner Output Reed //19 

RECD TYPE = VR 
LINE # •= 000010 
RECD # *= 00000019 
BLKNAME ■= ADDSENSOR 
BLK LVL “ 02 
STMT LVL - 00 
SRN •= COL 73-80 
STMT = ASSIGN 
DESCR ■= SENS2 
ATTRIB = LH 

Scanner Output Reed #22 

RECD TYPE * OP 
LINE # •= 000010 
RECD // - 00000022 
BLK NAME - ADDSENSOR 
BLK LVL - 02 
STMT LVL - 00 
SRN - COL 73-80 
STMT ' ASSIGN 
DESCR - ATTRIB - RH 
ATTRIB - 
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HAL/S Source 


IF SENSOR2 - 0 THEN 

IF SENSOR 1 - 0 THEN DO; 

DO FOR I - 1 TO 10; 

SENSOR3. SHUTOFF - SENS0RA$(I) . SENSOR5$(l); 
END; 

END; 


Scanner Output Reed For 1st IF 

RECD TYPE ■= ST 
LINE # = 000011 
RECD # = 00000032 
BLKNAME = HALSPGM 
BLK LVL = 01 
STMT LVL = 01 
SRN - 
STMT “IF 
DESCR “ 

ATTRIB “ 


Scanner Reed For 2nd IF 


Scanner Reed For 1st DO 


RECD TYPE “ ST 
LINE # = 000012 
RECD if “ 000000A2 
BLKNAME - HALSPGM 
BLK LVL “ 01 
STMT LVL “ 02 
SRN “ 

STMT - IF 
DESCR “ 

ATTRIB “ 


RECD TYPE “ ST 
LINE # - 000012 
RECD # “ 0000004A 
BLKNAME “ HALSPGM 
BLK LVL - 01 
STMT LVL “ 02 
SRN “ 

STMT - DO 
DESCR “ DISCRETE 
ATTRIB - 
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Scanner Reed For 2nd DO 


/ 

/ 


RECD TYPE - ST 
LINE // “ 000013 
RECD // - 00000048 
BLKNAME - HALSPGM 
ELK LVL - 01 
STMT LVL - 03 
SRN - 
STMT - DO 
DESCR - FOR RANGE 
ATTRIB = 


Scanner Reed For STRUCTURED Vrriable 


RECD TYPE - VR 
LINE # - 000014 
RECD y/ • 00000062 
BLKNAME » HALSPGM 
BLK LVL - 01 
STMT LVL - 03 
SRN - 

STMT - ASSIGN 

DESCR - SENSOR. SHUTOFF 

ATTKIB • LH 


Scanner Reed For Vector Dot Product 


RECD TYPE “ OP 
LINE // - 000014 
RECD // • 00000063 
BLKNAME - HALSPGM 
BLK LVL - 01 
STMT LVL •= 03 
SRN - 

STMT - ASSIGN 
DESCR “ . 

ATTRIB “ 
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Appendix C 
COMPLEXITY MEASURES 


"Software Structure Metrics Based on Inforsiation Flow" 
-Sal lie Henry and Dennis Kafura 
IEEE Transaction on Software Engineering, Sept. 1981 


Introduction. 

a) Objectives. 

i) To provide a practical technique for measuring large- 
scale systems thct can serve as a design aid. 

b) Characteristics. 

i) The major elements in the information flow analysis can 
be directly determined at design time. 

ii) The analysis reveals mere of the system connections than 
are revealed by other ordering relations such as 
"calls". 

iii) The analysis defines measurements for complexity, module 
coupling, level interactions, and stress points from the 
patterns of communications. 

Information Flow Concepts. 

a) Types of Information Flows. 

i) Global Flows - There is a global flow of 
from module A to module B through a global 
ture D if A deposits information into D and 
information from D. 

ii) Direct Local Flows ~ There is a local flow 
tion from module A to module B if A calls B. 

iii) Indirect Local Flows - There is a local t)ow 
ticn from module A to module B if: 


information 
data struc- 
B retrieves 


of informa- 


of informa 
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• B calls A and A returns a value to B which B utilizes, 
or 

• C calls both A and B passing an output value from A to 

B. 

b) Representations of Information Flows (Destination < — sourcel, 
source2, . . . .sourceN). 

i) X.n.I denotes the value of the nth parameter of proc X 
at invocation. 

ii) X.n.O denotes the value of the nth parameter of proc X 
at termination. 

iii) If X is a function, X.O denotes the value returned. 

iv) X.D denotes an access by proc X to the global data ob- 
ject 0. 

c) Advantages. 

i) The syntax of a language would not affect the form of 
relations . 

ii) No distinction is made between a flow of information es- 
tablished by a passed parameter and one established by a 
sh« ed global data structure. 

3. Complexity Measures. 

a) Procedures. 

i) Length * (Fan-in * Fan-oat) ** 2 

ii) Features identified by the measure. 

• Lack of functionality. 

• Stress points in the systeT. 

• Inadequate refinement. 

b) Module (All procedures th;>t access a particu. : data struc- 

ture) . 

i) Complete sum of the complexitie* of the procedures with- 
in the module. 

ii) Features identified by the measure. 
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• Poorly designed data structures. 

• Improper modularization. 

• Poor module design. 

• Poor functional decomposition, 
c) Interfaces. 

i) (The number of procedures exporting information from mo~ 
dule A + THE 

number of procedures importing information into module 
3) * The number of information paths. 

ii) Features identified by the measure. 

• Strength of the coupling between modules. 

• Measure of modifiability. 

A. Correlation of Information Flow for Complexity Measurements, 
a) Considerations concerning the correlation results: 

i) The Spearman's r test was used. 

ii) Program changes were used as an estimate for errors. 

iii) Eighty changes were considered. 


TABLE A 

Complexity Measure Correlation to Changes 



Correlation to 

Level of 

Measure 

Changes 

Significance 

(fan-in*fan-out) **2 

0.98 

0.028 

lengt) * (fan-in*fan-out) **2 

0.9A 

0.021 

(fan~in*fan-out) 

0.83 

0.0A2 

length**2 

0.60 

0.078 



fi 



Appendix D 

HAL/S COMPLEXITY FACTORS 

Following is the preliminary list of factors to measure the complexity 
of Shuttle Orbiter Primary Flight Software. This list was derived from 
the dissertation by Jean C. Zolnowski; "A System For Measuring Program 
Complexity". 

According to her work, there are four categories of measurements that 
can be made to programs written in FORTRAN or COBOL. We have tried to 
adapt the specific measurements in each of the categories to the con- 
structs found in the HAL/S language. Most of the measurements are in 
terms of "counting the numbers of ..." within a given program complex. 

1 . PROGRAM INTERACTIONS 

a) Connection information 

i) the number of: 

• PROGRAM BLOCKS 

• PROCEDURE BLOCKS 

• FUNCTION BLOCKS 

• TASK BLOCKS 

• UPDATE BLOCKS 

• COMPOOL BLOCKS 

ii) the number of calls to eacn PROCEDURE and FUNCTION 

iii) the nesting level of subprograms 
by Interface information 

i) the number of parameters for subprograms classified by: 

• data type (INTEGER, SCALAR ...) 

• call type (INPUT, ASSIGN) 
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ii) the nesting level of arguments and subprogram parameters 

iii) the number of SCHEDULED real time processes 

c) Macro usage 

i) the number of 1 macros 

ii) the number of arguments for each X macro 

iii) the number of macro calls 

iv) the number of REPLACE macros (text replacement) 

2. INSTRUCTION MIX CHARACTERISTICS 

a) the number of statements for each 

i) PROGRAM 

ii) PROCEDURE 

iii) FUNCTION 

iv) UPDATE 

v) TASK 

b) the number of statements by type: ’ 

i) Conditional 

iij Assignment/Computation 

iii) 1/0 

iv) Comment 

c) the number of FUNCTION references per statement 

d) the i. umber of real i'ime process statements 

e) the number of labels 

3 . DATA REFERENCE 

a) the number of variables by type: SCALAR, INTEGER, BIT, 

BOOLEAN, CHARACTER, VECTOR, MATRIX, STRUCTURE, EVENT 

b) for each variable 
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c) the number of references 

d) the percent of program span (scope) 

e) the average number of statements between each reference 

f) the number of elements for STRUCTURED types 

g) the number of CONSTANTS 

h) the number of dimensioned variables (ARRAY) 

i) the number of INITIALIZED variables by mode of initialization 
(STATIC or AUTOKATIC) 

j) the number of variables with RANGE, scaling or precision con- 
version, NAME. RANGE, LOCK, ACCESS, EXCLUSIVE, FIXED, 
EXTERNAL, RIGID, DENSE, ALIGNED, attributes 

k) the number of elements in each COMPOOL 

l) the number of variables assigned through input 

m) the number of times shaping is performed on variables 

A. STRUCTURE AND FLOW CHARACTERISTICS 

a) the number of conditionals by type (IF, DO ) 

b) the number of loops by type (DO . . . END, DO WHILE/UNTIL, DO 
FOR ) 

c) the length of each DO loop 

d) the nesting level of EK) loops 

e) the number of escapes from loops (REPEAT, EXIT, GO TO) 

f) the number of conditions, computations, function references 

per IF statement 

g) the nesting level of IF statements 

h) the number of jumps up and down (sequential flow altered) 

i) the number of unconditional branches 
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HAL/S SOURCE ANALYZER MODULE STRUCTURE 



Figure 1: Structure of HAL/S Analyzer 








Appendix F 

MEMBER LIST OF FSW APPLICATION SOURCE 


CDD032 

CGE1H3 

CGYMCl 

CNSSSTOR 

CSASMCMT 

CS0760 

CVAMMDIR 

CDD092 

CGE1H4 

CGYMC3 

CPADGT 

CSBPBDCM 

CS0780 

CVBBTU 

CDD142 

CGElMl 

CGYSTA 

CPADOW 

CSCCMT 

CS0790 

CVCS9DL 

CDF043 

CGE1M2 

CGZCOM 

CPAMSP 

CSCMMD 

CSUS60 

CS2IX3 

CDF053 

CGE2H1 

CGZFLD 

CPASCA 

CSCPAD 

CS0870 

CS2IX4 

COF063 

CGE2M1 

CGZFL2 

CPASSI 

CSCSCA 

CS0880 

CS2IX5 

CDF073 

CGE3H1 

CGZFL3 

CPCANI 

CSCTEX 

CS0890 

CS2IX6 

CDF083 

CGE3H2 

CGZMC2 

CPCCLT 

CSDHYB 

CSO 9 OO 

CS2IX7 

CDF123 

CGE3M1 

CGZMC3 

CPCCST 

CSDINI 

CSO 9 IO 

CS2PAR 

CDF 133 

CGGCOM 

CGZMSLT 

CPCDIT 

CSDMDT 

CSO 92 O 

CS2PAT 

CDF153 

CGGCOl 

CGZRMCSC 

CPCGXT 

CSI»TCCM 

CSO 93 O 

CS2PCT 

CDHMMUTl 

CGGC02 

CGZIDI 

CPCPCI 

CSIA06SC 

CS0940 

CS2PDT 

CDIMMUTl 

CGGC03 

CGZ123 

CPCTCI 

CSIAllSC 

C‘50q60 

CS2PXT 

CDVS9C 

CGGC13 

CGZ238 

CPCVID 

CSIA16SC 

CSO 97 O 

CS2PX2 

CDWDOWNL 

CGGDOl 

CGZ28C 

CPCCNC 

CSICDA 

CS2DART 

CS2PX3 

CGAOAX 

CGGFLO 

CG0180 

CPKCOT 

CSIPLC 

CS2IFT 

CS2SAT 

CGAMCl 

CGGFLT 

CGCI 9 O 

CPSSSC 

CSISCMT 

CS2INB 

CS2000 

CGAlMC 

CGIGNC 

CG0200 

CPSSSU 

CSI06CSM 

CS2IPT 

CS2010 

CGA2MC 

CGKKIP 

CG0210 

CP2GXT 

CSIllSCM 

CS2IXP 

CS2011 

CGA3MC 

CGKMC2 

CG0220 

CRATE 

CSI16SCM 

CS2IX2 

CS2020 

CGBIHl 

CGK136 

CG0230 

CRBMCI 

CSMAMCMT 

CS2IX3 

CS2021 

CGBIH2 

CGMCOM 

CGNCOM 

CRCCOT 

CSPCLB 

CS2IX4 

CS2030 

CGBIMl 

CGMIPC 

CG0250 

CROC I L 

CSPCON 

CS2IX5 

CS2040 

CGBIM3 

CGMIPF 

CG0330 

CREMCC 

CSPTEC 

CS2IX6 

CS2050 

CGBOBF 

CGMIPM 

CG0340 

CRFASC 

CSSCOT 

CS2IX7 

CVAMMDIR 

CGCCOM 

CGMMC2 

CG0400 

CRILVC 

CSSDDT 

CS2PAR 

CVBBTU 

CGCFLl 

CGMMC9 

CG0410 

CRTDIS 

CSSSPA 

CS2PAT 

CVCS9DL 

CGCFL2 

CGMMRW 

CG0420 

CSABCT 

CSSSPCMT 

CS2PCT 

CVIffiDCOC 

CGCFL3 

CGNCON 

CG0430 

CSADART 

CSSSPINB 

CS2PDT 

CVTOFLCO 

CGCUNl 

CGNFLT 

CG0440 

CSAERT 

CSSSPOB 

CS2PXT 

CVEC'^MBU 

CGEBFS 

CGNFLl 

CG0500 

CSAIFT 

CSSTMCOT 

CS2PX2 

cvrrRTCo 

CGEDIS 

CGNFL2 

CG05I0 

CSAINB 

CSI06SCM 

CS2PX3 

CVGGTSCO 

CGEFLT 

CGNMCl 

CG0520 

CSAIPT 

CSTCAT 

CS2SAT 

CVHHDA 

CGEGNC 

CGNMC2 

CG0530 

CSAIXP 

CSTTMC 

CS2000 

CVHPLD 

CGEIPA 

CGNMC3 

CGlOll 

CSAPAR 

CSZICCCM 

CS2010 

CVIMMUTI 

CGEIPB 

CGRRMC 

CG2011 

CSAPAT 

CS0600 

CS2011 

CVJFDECP 

CGEIPC 

CGRRMO 

CG3011 

CSAPCT 

CE0610 

CS2020 

CVKSACSC 

CGEIPD 

CGSASl 

CG3041 

CSAPDT 

CS0620 

CS2021 

CVLONESH 

CGEIPF 

CGSGNC 

CG3051 

CSAPFT 

CS0660 

CS2030 

CVLTFLCO 

.GEIHI 

CGYCAT 

CG8011 

CSAPXT 

CS0670 

CS2040 

CVBMFDCO 

CGE1H2 

CGYFLl 

CG9011 

CSASAT 

CS0680 

CS2050 

CVMLOAD 
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CVMS8C0M 

GAGENT 

GI»ENT 

GGOTGT 

GKEKIP 

GMYRGM 

GPEELV 

CVNMMUTI 

GAHRTL 

GDSSWP 

GGQCOM 

GKFHOR 

GMZPLA 

GPFORB 

CVPAPTCO 

GAIORB 

GDTHUD 

GGRENT 

GKGMNV 

GMICOM 

GPGYAW 

CVQMMUTI 

GCAAER 

GDWASC 

GGSENT 

GKIORB 

GM2MAJ 

GPHSBT 

CVRDPERR 

GCBAER 

GDXAMI 

GGTTAE 

GKKORB 

GM3PLA 

GPILAN 

CVSSSTCO 

GCCAER 

GDYASC 

GGUUPE 

GKMRMS 

GM7SUB 

GPKOMS 

CVTTCSUN 

GCDAER 

GDZAMI 

GGVPOS 

GKNRCS 

GM9MAS 

GPLOMS 

CVUSRBCO 

GCEAER 

GEAASC 

GGWVCO 

GKORMO 

GNAMLS 

GPN160 

CVVLDBCO 

GCFAER 

GEBADH 

GGXPGI 

GKQORB 

GNBTAC 

GPORUD 

CVWLDBPO 

GCGSSM 

GECRDH 

GGYHAC 

GKRORB 

GNCBAR 

GPPSRB 

CVWMMULD 

GCHGRT 

GEEADM 

GG2PSP 

GKSSTA 

GNDDRA 

GPQSPT 

CVXARFCO 

GCIGRT 

GEFRDM 

GGIASC 

GKTUNI 

GNEENT 

GPRMPS 

CVYADTDA 

GCJASC 

GEGASC 

GG2ASC 

GKUIMU 

GNFEAR 

GPSASC 

CVMBFDCO 

GCKGCS 

GEHRTL 

GG31ST 

GKVREL 

GNGEFT 

GPTSSM 

CVZMCDS 

GAIORB 

GEIORB 

GGA2ND 

GKWRMS 

GNIMEA 

GPUMPS 

CVILSRES 

GCAAER 

GEJORB 

GG50RB 

GKXRMC 

GNJEFT 

GPVSRB 

CVIOOO 

GCBAER 

GEKORB 

GG6ABR 

GKYHFE 

GNKGEO 

GPW3AX 

CVlOlO 

GCCAER 

GELORB 

GG7PWR 

GK2LND 

GNLEFT 

GPXSRB 

CV1020 

GCDAER 

GEMEDH 

GG9GLI 

GK30RB 

GNMEFT 

GPYMEC 

CV1040 

GCEAER 

GENEI»1 

GHADEO 

GKATIM 

GNNANG 

GPZORB 

CV1050 

GCFAER 

GEPENT 

GHBCMD 

GK5MNV 

GNOATT 

GPOTHC 

CV1060 

GCGSSM 

GEQENT 

GHCORB 

GLDONO 

GNPTAC 

GPIORB 

CVllOO 

GCHGRT 

GERENT 

GHDUPM 

GLEPIK 

GNQNAV 

GP20RB 

CV1120 

GCIGRT 

GESODH 

GHEUPG 

GLFFAN 

GNRSVI 

GP3CHE 

CV2LIN 

GCJASC 

GETODM 

GHFNRM 

GLOOPS 

GNTSUP 

GP4CHE 

CV2SIN 

GCKGCS 

GFATRA 

GHGREF 

GLUACC 

GNUACC 

GP5CHE 

CV3GMEMW 

GCLOPS 

GFBRCS 

GHHPHA 

GLIORB 

GNVATT 

GP6MPS 

CV3LOT 

GCMGCS 

GFCREC 

GHIPHA 

GL2AUT 

GNWATT 

GP7HYD 

CV3SOT 

GCOASC 

GFEIHT 

GHJRTL 

GL5NAV 

GNXATT 

GP8HYD 

CV8011 

GCPGCS 

GFFORB 

GHKRTL 

GMAMIN 

GNYATT 

GP9MPS 

CV9LSRES 

GCQORB 

GFHGRT 

GHLRTL 

GMBIMU 

GNZATT 

GQARNG 

CV9011 

GCRORB 

GFIGRT 

GHMRTL 

GMCACP 

GNIMEA 

GQBBRG 

DCDDGl 

GCTFCS 

GFJGRT 

GHOORB 

GMDRES 

GNIDAT 

GQCCOM 

DCDDG2 

GCUGCS 

GFKGRT 

GHPORB 

GMESTA 

GN2ENT 

3QDHYD 

DCDDG3 

GCVDBA 

GFL12H 

GHQPEG 

GMFGYO 

GN3ENT 

GRASWI 

DCDDG8 

GCWQUA 

GFMJSE 

GHRTAC 

GMGMAJ 

GNARTL 

GRBSWI 

DCDDG9 

GCOORB 

GFNGRT 

GHSMNV 

GMHACP 

GN5NAV 

GRCSBT 

DCDDOW 

GCAORB 

GFPAER 

GHTDEO 

GMJINE 

GN6COV 

GRDORB 

DCDDS2 

GC50RB 

GGAAUT 

GHUDEO 

GMKGYO 

GN7ENT 

GREAAF 

DCDDS8 

GC70RB 

GGBUPR 

GHVVGO 

GMLACP 

GN8ASC 

GRFAER 

DCDDS9 

GC80RB 

GGCAUT 

GHWORB 

GMhLAT 

GN9ASC 

GRGFIX 

DGEGSEER 

GC90RB 

GGDAUT 

GHXORB 

GMNLSF 

GOAGNC 

GRHIMU 

DGILDBIO 

GDAASC 

GGEENT 

GHZUPP 

GMOTER 

GOBSMP 

GRJIMU 

DGOGSECO 

GDEENT 

GGFAUT 

GHIDEO 

GMPTNB 

GOIASC 

GRKIMU 

DGRGSERO 

GDFORB 

GGGAUT 

GHARTL 

GMRTRA 

G020RB 

GRLIMU 

DMPMMMSG 

GDGDEO 

GGILTV 

GH6ABR 

GMSIMU 

G03ENT 

GRMIMU 

GAALIM 

GDI AM I 

GGJRTL 

GH7UPP 

GMTPFL 

G06RTL 

GRNOMS 

GABDIR 

GDMSPl 

GGKASC 

GH8EAR 

GNUHAN 

G080RB 

GRORCS 

GADHFE 

GDNHSI 

GGLACC 

GKBRMSW2 

GMVHAN 

GPABFS 

GRPBFC 

GAEASC 

GDORTL 

GGMGLI 

GKCASC 

GMWHAN 

GPCAER 

GRQRFC 

GAFORB 

GDPSWP 

GGNSSM 

GKDASC 

GMXGCA 

GPDAER 

GRRRCS 
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GRSIMU 

GULHOR 

GWORMR 

GRTFIX 

GUMRMC 

GWQORB 

GRUFLO 

GUNRMS 

GWRORB 

GRXADT 

GUPENT 

GMSORB 

GRYTAC 

GUQCON 

GWVORB 

GRZMLS 

GURRMS 

GWWORB 

GRIRMI 

GUSCSC 

GWXORB 

GR20RB 

GVAMLS 

GWYORB 

GR40RB 

GVBTAC 

GWZRCS 

GR50RB 

GVCBAR 

GXJORB 

GR60RB 

GVDDRA 

GX4DIS 

GR7SRB 

GVFRVT 

GYAADT 

GR8RCS 

GVGUVW 

GYBADT 

GR9RCS 

GVIQUA 

GYCADT 

GSAXFD 

GVJVEC 

GYDNAV 

GSDFIR 

GVKCOV 

GYEADT 

GSESRB 

GVLHEL 

GYFADT 

GSFABT 

GVMVRE 

GYGADT 

GSGORB 

GVNCOV 

GYHADT 

GSHHYD 

GVOOPS 

GYIADT 

GSIABT 

GVPRUN 

GYKLMS 

GSLORB 

GVQSIT 

GYKMLS 

GSMMPS 

GVRTAC 

GYLMLS 

GSPMPS 

GVSQUA 

GYMMLS 

GSQASC 

GVTPRE 

GYNRRP 

GSRRSL 

GVUUNI 

GYRRAD 

GSSSSM 

GVWQUA 

GYTTAC 

GSTETS 

GVXQUA 

GYUTAC 

GSUQUA 

GVYQUA 

GYVAUT 

GRQRHC 

GVZMAT 

GYXADT 

GRIRMI 

GV2DEL 

GYYADT 

GR50MS 

GV3RTL 

GYZSTS 

GSVGAG 

GV5STA 

GYISTS 

GSWORB 

GV6STA 

GY3STT 

GSYDSC 

GV7RTL 

GY4STS 

GS5ASC 

GWAORB 

GY5FOV 

GTAUPL 

GWBORB 

GY6COA 

GTBUPL 

GWCUNI 

GY7STC 

GTCUPL 

GWDRMO 

GY8DAT 

GTDUPL 

GWERMR 

GZBORB 

GUARMO 

GWFREL 

GZCRNG 

GUBRMS 

GWGORB 

GZDDIP 

GUCIMU 

GWHORB 

GZGENT 

GUDORB 

GWIORB 

GZHDIP 

GUEREL 

GWJORB 

GZIASC 

GUFORB 

GWKORB 

GZJSTA 

GUHRMR 

GWLRMCSF 

GZLCON 

GUISTA 

GWMORB 

GZ.'iASC 

GUJORB 

GWNMNV 

GZNENT 


GZPBUR 

RVMCON 

VASSRB 

GZVVER 

RWPPHC 

VATMMDRE 

GZX6XT 

RXYCIN 

VAXMCIUI 

GZYENT 

RYECNV 

VAYBUFAV 

GZZASC 

SACPMU 

VAZTCSCL 

IMUCAL 

SAFaCQ 

VBATESTT 

PCINIT 

SAM ITEM 

VBBIOERR 

PCKITE 

SBCSM 

VBCMISCO 

PCLSER 

SBDITEM 

VBDMDMSE 

PCMDIS 

SBISM 

VBEMODUL 

PCPPEP 

SBSBACKS 

VBFERROR 

PCRPUL 

SCICLN 

VBQBITEA 

PCWSOF 

SCKPNT 

VBTBTUCO 

PCISPE 

SCMSUB 

VBILEVEL 

PC2SPE 

SCSSPEC 

VB2LEVEL 

PDLIUS 

SDTSM 

VB9BTUSP 

PDSSEQ 

SLSSPEC 

VCACOLLA 

PL20PS 

SMCKPT 

VCMCSLMT 

PMCCYC 

SM20PS 

VCUCSLCL 

PMGGNC 

SPEPSP 

VCYCYCUP 

PMOSTA 

SPNINT 

VDEL.EDDI 

PMQTEC 

SPPPRECO 

\DFDFLMO 

PUIMUP 

SPRPRB 

VDRDDURA 

PU2MUP 

RNCENC 

VEHDPERR 

PU3MUP 

SPSPSP 

VFRTINPT 

PU4MUP 

GRESTO 

VGTGTS 

PU5MUP 

SSAAPUFU 

VG90PS9 

PU6MUP 

SSBPLBAY 

VHAHDA 

PU7MUP 

SSCFUELC 

VJILSRES 

PU8MUP 

SSFFUELC 

VJ9LSRES 

RASAUT 

SSHHYD 

VKISACSI 

RBMHDW 

SSMANTMG 

VKRRESPX 

RCDDCO 

SSN02N2Q 

VK3CMEMW 

RDDDDI 

SSOSPDAT 

VLBONESH 

REXRMS 

SSPEXEC 

VMBBUFLA 

RFPPOS 

SSRREC 

VMDBFDCA 

RHMHLT 

SSSSTAND 

VMELOAD 

R I ITEM 

SSTHYDFL 

VMMMMSPE 

RJSHAN 

STCCYCl 

"MPITEMP 

RKGKIN 

STMTAB 

VMIBFDCY 

RMCSPE 

STSSPEC 

VM2BDYFL 

RMCENC 

SULUPLIN 

VM3BFDLI 

RPORPO 

S2ICLNU? 

VM4BFSHU 

RQCIPC 

VAASEQUE 

VNACLEAN 

RRPRRA 

VAGTIMEO 

VNECYCLI 

RSCSIN 

VAHCLEAN 

VNFCYCLI 

RTVTOT 

VAIMTSDR 

VNISSTIC 

RUDKYB 

VAMMMDIR 

VN2SST2C 

RVICLN 

VAPPRTYC 

VN3040KI 


VN4041KI 

VN6RCSEX 

VN7LIMIT 

VN8LIMIT 

VN9MLSCK 

VOMOOl 

VRJDTOGG 

VRMRMPAR 

VRPRAMPC 

VRIRMPCY 

VSLMLSPR 

VSPPARAM 

VSRRCSPR 

VSISPECG 

VS2SPECG 

VS5SSTPR 

VS6SSTPR 

VTCTCSCO 

VTLTFLMO 

VULMMINT 

VUTMATIN 

VUUMATCY 

VWFWFG 

VXCDCSWI 

VXDADTST 

VXEERROR 

VXFFEEDB 

VXFFLAGR 

VXINPUT ' 

VXMMIDVA 

VXOOMSDI 

VXPAPT 

VXRKIP 

VOITCSSC 

V02TCSSA 

V080PS8 

V090PS9 

XG0180 

XG0210 

XG0220 

XG0500 

XG0510 

XG0520 

XGlOll 

XG3011 

XG3041 

XG3051 
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Appendix G 

MEMBER LIST OF INCLUDE SOURCE 


AIGDEULO 

DAG//RAM 

DCDI3225 

VB17DECL 

VS4X4 

XREF5SW 

DFG0860 

AMTOOOl 

DAMTTEMP 

DCD1A2HS 

VB2LMCIU 

VS5X5 

XREFVSM 

DFG0870 

ANNUNTBL 

DAPPFMPT 

DCDI4201 

VB21MDMS 

VS6X6 

ZMMAREAS 

DFG0880 

ANThACS 

DAPPFSD 

DCD14205 

VB22BSRV 

VS7X7 

ZPRIOTIM 

DFG0890 

AOIXTAB 

DBG#RAM 

DCD142I2 

VB23SCUM 

VS8X8 

DCD15305 

DFG0900 

AOIYTAB 

DCDMMBEG 

DCD14225 

VB24PROM 

VTLMMDIR 

DCD15312 

DFG0910 

AOIYTMSC 

DCDMMDCL 

DCD144HS 

VB25SCUP 

VUCMDWDS 

DCD15325 

DFG0920 

A02XTAB 

DCDMMDMP 

DCD14401 

VB26ADCV 

VXACOMPA 

DCD160HS 

DFG0930 

A02YTAB 

DCDMMEND 

DCD14405 

VB27BTE4 

VOIX 

DCD16001 

DFG0940 

A02YTMSC 

DCDMNBEG 

DCD14412 

VB31DFI 

VOIYTFL 

DCD16005 

DFG0960 

A03XTAB 

DCDMNDMP 

DCD14425 

VB32PDI 

V02X 

DCD16012 

DFG0970 

A03YTAB 

DCDMNEND 

DCD146HS 

VB33NRAM 

V03XDFL 

DCD16025 

DFG2SMP2 

A03YTMSC 

DCD120HS 

DCD 14601 

VB36NMOD 

V03YDFL 

DCG//R.\M 

DFG2000 

A04XTAB 

DCDI2001 

DCD14605 

VC0AMT08 

V04XDFL 

:^DG//RAM 

DFG2010 

AOAYTAB 

DCD12005 

DCD14612 

VC0AMT12 

VlAXFCS 

DDUMACS 

DFG2011 

A04YTMSC 

DCD12012 

DCD14625 

VC0AMT13 

VIAYFCS 

DDOOOID 

DFG2020 

A05XTAB 

DCD12025 

DCD148HS 

VCOMDT 

VIBXFCS 

DDOOIOD 

DFG2021 

BDPMMACS 

DCD12IHS 

DCD14801 

VC00400 

VICXFCS 

DD0020D 

DFG2030 

BMODMACS 

DCD12101 

DCD14805 

VC00410 

VIDXFCS 

DD0060D 

DFG0240 

BRMACS 

DCD12105 

DCD14812 

VCOIOOO 

VIEXFCS 

DD0990D 

DFG0250 

CAMEMACS 

DCD12112 

DCD14825 

VCOlOlO 

VIFXFCS 

DEG#RAM 

DFG3041 

CAMIMACS 

DCDI2125 

DCD152HS 

VC01020 

VIGXFCS 

DEUMACS 

DFG4FSP 

CDVCOMPO 

DCD122HS 

DCD15201 

VC01050 

VIHXFCS 

DFGMDAS 

DFG40PSO 

CGBIM2 

DCD12201 

DCD15205 

VC01060 

VlIXFCS 

DFGMDAT 

DFG4SMP4 

CMRMACS 

DCD12205 

DCD15212 

VCOllOO 

VIJXFCS 

DFGMDATZ 

DFG4SPC1 

CMSMACS 

DCDI2212 

DCD15225 

VC01120 

VIKXFCS 

DFGMDAX 

DFG4SP60 

CPAPID 

DCD12225 

DCD153HS 

VC08011 

VILXFCS 

DFGMDAZ 

DFG4TIME 

CPDMSP 

DCD123HS 

DCD15301 

VC09011 

VIMXFCS 

DFGNULLN 

DFLMMDIR 

CSACDA 

DCD12301 

TCSMACS 

VNlXl 

VINXFCS 

DFGPROT 

DFMPTMSK 

CSAPLC 

DCD12305 

TIOMACS 

VNIYI 

VIOXFCS 

DFGSPEC 

DFT0020 

CSCA06SC 

DCD12312 

TMPMACS 

VN2X2 

VIPXFCS 

DFGTIME 

DGIGOAHE 

CSCAllSC 

DCD12325 

TMYTABS 

VN3X3 

VIQXFCS 

DFG0600 

DGIHEREC 

CSCA16SC 

DCD12AHS 

TRCMACS 

VN4X4 

VIRXFCS 

DFG0610 

DGI INTER 

CSCOTSRC 

DCD1240I 

VBOIERRC 

VN5X5 

VISXFCS 

DFG0620 

DGIINTWD 

CSCSCMT 

DCD12A05 

VB02ITEM 

VN6X6 

VITXFCS 

DFG0660 

DGISTATR 

CSC06SCM 

DCD12412 

VBILMCIU 

VN7X7 

VlUXFCS 

DFG0670 

DGI STATU 

CSCllSCM 

DCD12425 

VBllMDMS 

VN8X8 

VIVXFCS 

DFG0680 

DGNCFMPT 

CSC16SCM 

DCD132HS 

VB12PCMU 

VSIXI 

VIWXFCS 

DFG0760 

DGNCrSD 

CSSCOTR 

DCD13201 

VB13DDUS 

VSIYI 

VIXXFCS 

DFG0770 

DGUieOD 

CSSSXTR 

DCP13205 

VB15REPL 

VS2X2 

XREFDCI 

DFG0780 

DGC210D 

CWWRMACS 

DCD13212 

VB16DECL 

VS3X3 
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XREFGNC 

DFG0790 

!X;0270D 


DG0500D 

GNOGLD 

G6D602 

MG0250M 

MS0096H 

PFFOMACS 

S13XHDT 

DG0510D 

GNOGLE 

G8AMTP07 

NG0330M 

MS0600M 

PFMDMACS 

S13YMDT 

DG0520D 

GNOGLF 

G8DA20 

MG03A0H 

HS0610M 

PFIMACS 

SIAXMDT 

DGIOIID 

GNOGLU 

G8DA30 

MGOAOOM 

MS0620H 

PF2MACS 

siaymdt 

DG3011D 

GNSBET 

G8DAA0 

MGOAxOM 

HS0660M 

PHODHACS 

S15XHDT 

DG3041D 

GOEDAT 

G8D801 

MG0A20M 

MS0670M 

PMUNACS 

S15YMDT 

DG3051D 

GOESSP 

G90SHACS 

MG0A30H 

HS0680N 

PREMACS 

S16XHDT 

DIVOGNC 

GOFANT 

HNHM 

MGOAAOM 

MS0760M 

PROTMACS 

S16YMDT 

DIVOSSW 

GOGSCM 

IMUHACS 

MG0500H 

HS0780M 

PSPIMACS 

S17XMDT 

DIVOVSM 

GOIMFL 

lOGNC 

MG0510M 

MS0790M 

PSP2MACS 

S17YMDT 

im//HACS 

GOINPT 

lONACS 

MG0520M 

HS0860M 

RDI SHAGS 

S18XHDT 

DPLFMPT 

GOLITE 

lOSSW 

MG0530M 

MS0870M 

RLTHMACS 

S18YMDT 

DPLFSD 

GOOATT 

lOVSM 

MGIOIIM 

MS088CM 

RSFSMACS 

S19XMDT 

DSSFMPT 

GOOPMK 

IPINGl 

MGIOAOM 

HS0890M 

RSTDMACS 

S19YMDT 

DSSFSD 

GOOSSM 

IPING2 

MG1060M 

MS0900M 

SDADCL 

S20XMDT 

DVUFMPT 

GOPDAT 

IPING3 

MG1120M 

MS0910M 

SETDMACS 

S20YMDT 

DVUFSD 

GOQCOD 

II ING8 

MG2011H 

MS0920M 

SLTHMACS 

S21XMDT 

D26XS2G1 

GOQUAT 

IPING9 

MG2021M 

HS0930H 

SMFDA 

S21YMDT 

FAOTMACS 

GOSCHO 

IPINS2 

MG3011M 

MS09A0M 

SHSSMACS 

S22XHDT 

FCBTMACS 

GOTMID 

IPINS9 

MG30A1M 

HS0960M 

SMSTAT 

S22YMDT 

FFSMACS 

GPMRCS 

IPINV9 

MG3051M 

MS0970M 

SRBHACS 

S23XMDT 

FLEXDATA 

GRIATT 

IPINXO 

MG8011M 

MSI DOOM 

STBYMACS 

S23YMDT 

FLEXTBL 

GRIMUL 

IPXO 

MMUMACS 

MSIOIOM 

STRPCT 

S2AXMDT 

FPMMMDIR 

GSOVEN 

LDBMACS 

MP0710M 

MS1020M 

STRPDT 

S2AYMDT 

FTBAMTll 

GXKCLR 

MDAXATMS 

MP0720M 

MS1050M 

STUB 

S25XMDT 

FTBD0710 

GXOTER 

MDAYATMS 

MP0721M 

MS0160M 

SUMHACS 

S25YMDT 

FTBD0721 

GXQCLR 

MDPMACS 

MP0730M 

MSllOOM 

SYNCMACS 

S26XMDT 

FTED0731 

GlAMTPOA 

MDOOOIM 

MP0731M 

MS1120M 

SOIXMDT 

S26YMDT 

FTBD07A1 

GIDIOI 

MD0002M 

MP07A0M 

MS2000M 

SOIYMDT 

S27XMDT 

FTBD0751 

G1D510 

MD0003M 

MP07A1M 

MS2010M 

S02XMDT 

S28XHDT 

FTBD0762 

G1D520 

MDOOIOM 

MP0750M 

MS2011M 

S02YMDT 

S29XMDT 

FTBD7011 

G2AMTP05 

MDOOllM 

MP0751M 

HS2020M 

S03XMDT 

S30XMDT 

DFG2040 

G2D200 

ND0020N 

MP0752M 

MS2021M 

S03YMDT 

S31XMDT 

DFG2050 

G2D201 

MD0030M 

MP0760M 

MS2030M 

SOAXMDT 

S32XNDT 

FXFLHACS 

G2D20101 

MD0031M 

MP0762M 

MS20A0M 

SOAYMDT 

S33XMDT 

GD1HSI6 

G2D202 

MDOOAOM 

MP5001M 

MS2050M 

S05XMDT 

S3AXMDT 

GD2HSI3 

G2D210 

MDOOAlrt 

MP5002M 

HS8011M 

SOSYi'DT 

S35XMDT 

GD3HSISC 

G2D220 

MD0060M 

MP7011M 

MS905 IM 

S06XMDT 

S36XHDT 

GEDISP 

G2D230 

MD0990M 

MP9011M 

MS9999M 

S06YMDT 

S37XMDT 

GEIHIB 

G2D250 

MD9999M 

MSOOA3M 

MTUCMACS 

S07XMDT 

S38XHDT 

GE2HIA 

G2D330 

MECMACS 

MSOOAAM 

MTUMACS 

S07YMDT 

S39XMDT 

GE3HII 

G2D3A0 

METKACS 

NSOOA5H 

NHCSECTS 

S08XMDT 

SAOXMDT 

GEAHIB 

G3AMTP06 

MGOOA2M 

MS0061M 

NHHANXRF 

S08YI0)T 

SAIXMDT 

GE5MOB 

G3D018 

MG0092M 

MS0062M 

OPSCMACS 

S09XHDT 

SA2XHDT 

GE6hlA 

G3D053 

MG0093N 

MS0070M 

OPSIMACS 

S09YMDT 

SA3XMDT 

GE7MOA 

G3D190 

MG0180N 

NS0081N 

OPSTMACS 

SIOXMDT 

SAAXMDT 

GE8M0B 

G3D301 

NG0190M 

NS0082H 

OPSUPMAC 

SlOYMDT 

SA5XMDT 

GFORCS 

G3D30A 

MG0200M 

MS0083M 

CVLYMACS 

SllXMDT 

SA6XHOT 

GKPMNV 

G3D305 

NG0210N 

NS008AN 

PDIMACS 

SllYMDT 

SA7XMDT 

GM5TOR 

G3D500 

MG0220N 

NS009AM 

PDSTEMPL 

S12XMDT 

SA8XMDT 

GNC910A0 

G6D601 

MG0230M 

MS0095M 

PFBTMACS 

S12YHDT 

SA9XNDT 
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S50XMDT 

S51XMDT 

S52XMDT 

S53XMDT 

S54XMDT 


S55XMDT 

S56XMDT 

S57XKDT 

S58XMDT 

S59XMDT 


S60XMDT 

S61XMDT 

S62XMDT 

S63XMDT 

S64XMDT 


S65XMDT 

S66XKDT 

S67XMDT 

S68XMOT 

S69XMDT 


S70XMDT 

S71XMDT 

S72XMDT 

S73XMDT 

S74XMDT 


S75XMDT 

S76X11DT 

S77XMDT 

S78XMDT 
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//CFIOCGR 

//DFIONDX 

y/ZFIOCGR 

AIBGPCLO 

AIESIP 

AIGDEUP 

AMTP02 

AMTPOA 

AMTP05 

AMTP06 

AMTP07 

AMTP08 

AMTPll 

AMTP12 

AMTP13 

AMTP15 

ARAGPCSW 

ARC//GPC 

ARDCSBUS 

ARDMFBUS 

ARDRSBUS 

ARFDPSCO 

ARG#REC 

ARK/ZDOW 

ASCTIMEM 

ASGCYCLl 

ASHRWCYC 

ASLTMC 

ASK.\UX 

ASNGMENW 

CAASCCOM 

CABCOMPO 

r!)B021 

•^DriT 

••^0022 

CDD102 

CDF023 

CL'"!]: 

CD0024 

CDG044 

CDG054 
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Appendix H 

MEMBER LIST OF SYSTEM SOURCE 


CDG064 
CDG07A 
CDG084 
CDGllA 
CDG124 
CDG134 
CDG154 
CDH025 
CDH045 
CDH055 
CDH065 
CH0754 
CDH085 
CDH115 
CDH125 
CDH135 
CDH155 
CDJRWD 
CDKDIC 
CDLANNUN 
CDM#COM 
CDND03 
CDND04 
CDND05 
CDND06 
CDND07 
CDND08 
CDND05 
CDNDIO 
CDNDl i 
CDND12 
CDNDl 3 
CDNDl 4 
CDNDl 5 
r.DH075 
CDM02 
CDN202 
CDN302 
CDPDIC 
CDQ ANNUM 
CDR02D 


CDR04D 

CDR05D 

CDR06D 

CDR07D 

CDR08D 

CDRllD 

CDRIT'D 

CDR13D 

CDR15D 

CDSDIC 

CDTANNUN 

CDU//l,NK 

CDXDAT 

CDYDIC 

CDZANNUN 

CDOOOl 

CD0002 

CD0003 

CDOOlO 

CD0020 

CD0060 

CD07XX 

CD0990 

CD1#DFB1 

CZ1//C0M 

CZ2C0MM0 

CZ3/ZC0M 

DCI#CYC 

DCI//DATA 

DCI#PDE 

DCIjjfSTK 

DFLDCU 

DGMWRT 

DGNLIGHT 

DG9LIGHT 

DIMjfflCC 

DIRIOR 

DISjffPLAY 

DLALIGHT 

DMAMAC 

DMCSUPR 


DMi4NEW 

DMRRESUM 

DMTERR 

DMZLOG 

EWIKEY 

I»<2APP 

EW3DIS 

DXXCSE 

FCMBCEMD 

FCMBMTPG 

FCMBMTS2 

FCMBMT02 

FCMBMT16 

FCMBMT38 

FCMBMT89 

FCMBOOT 

FCMBUSCM 

FCMBUSPC 

FCMCBLKS 

FCMCKSUM 

FCMCOM 

FCMCSYNC 

FCMDSCRM 

FCNFDl 

FCMINBCE 

FCMINIOP 

FCMINMSC 

FCMINSSL 

FCMISYNC 

FCMLINIT 

FCMMGBOV 

FCMMGPOV 

FCMMGPT 

FCMNINIT 

FCMPAT26 

FCMPMOD 

FCMPROTD 

FCMPSA 

FCMRSTFC 

FCMRTBLE 

FCMSAVE 


FCMSFAIL 

FCMSFCAM 

FCMSfINT 

FCMSMASK 

FCMSSLPT 

FCMSSYNC 

FCMSVC 

FCMSVOTE 

FCMSWMON 

FCMTBLG9 

FCMTBLPG 

FCMTBLS2 

FCMTBL02 

FCMTBL16 

FCMTBL38 

FCMTBL39 

FCMTRACF, 

FCMTRCLG 

FCMTSYNC 

FCMUPLOD 

FCMZCONS 

FDDUMMY 

FIOACTMD 

FIOACT02 

FIOADCCL 

FIOADCNS 

FIOCBLKS 

FIOCDATG 

FIOCDATS 

FIOCMPLT 

FIOCOUNT 

FIOCTR 

FIOCYCSM 

FIOCYCTB 

FIOCYC02 

FIODDUPG 

FIODEUPG 

FIOERRLA 

FIOERRLB 

FIOERRLC 

FIOGNCDL 


FIOGNIPG 

FI0G90PG 

FIOHFEPG 

FI0HFE02 

FI0HFE16 

FI0HFE38 

FI0HFE89 

FTOHISAM 

FIOICCPG 

FIOIMUPG 

FIOLDbPG 

FIOLGERR 

FIOMCIPG 

FIOMCNTL 

FIOMDMPG 

FIOMDPPG 

FIOMDPPG 

FI0MFEG9 

FIOMFEPG 

FI0MFE02 

FI0MFE16 

FIOMFE38 

FIOMGCMP 

FIOMGCV 

FIOMGDSP 

FIOMGERR 

FIOMGMTR 

FIOMGSNC 

FIOMGSTR 

fiomgtoe 

FIOMMGTG 

FIOMMMSC 

FIOMMUPG 

FIOMODSM 

FIOMODTB 

FI0M0D02 

FI0MS2DT 

FI0MS2PG 

floJtUWPG 

FIOMVUDT 

FIOMVUPG 


FIONSPPG 

FI0PBYG9 

FI0PBYS2 

FIOPBYTB 

FIOPBY02 

FI0PBY16 

FI0PBY38 

FI0PBY89 

FI0PDG9 

FIOPDHF 

FIOPDIPG 

FIOPDTSP 

FIOPDSriU 

FI0PDSM2 

FIOPDSPG 

FIOPDSRB 

FIOPDVU 

FIOPMUPG 

FIOPRMPG 

FIOPSPPG 

PIOPURGE 

FIORTBUF 

FIOSMDPG 

FIOSMFPG 

FIOSRBPG 

FIOSTMSC 

FIOSVC 

FIOSVCP 

FPMCANCL 

FPMCHPCT 

FPMCHTQE 

PPh-LOSE 

FPMCVTFL 

FPMCVTFX 

FPMDCU 

FPMDISP 

FPMDSABL 

FPMENABL 

FPMERLOG 

FPMEVAL 

FPMEVDFQ 
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FPMEVENQ 

FPMFCLOS 

FPMFRPCT 

FPMFXMTU 

FPMGMTIM 

FPKIDLE 

FPMIDTIM 

FPMIHIM 

FPMIHPCl 


FPMIHPC2 

FPMRESET 

FPMIHPGM 

FPMRI P''T 

FPMINHSP 

FPliSCHED 

FPMITUPD 

FPMSDERR 

FPMMTUFX 

vpMSET 

FPMMTURM 

FPMSIGNL 

FPMOPSCN 

FPMSIO 

FPMREL 

FPMSVC 

FPMRES 

FPMSVCEP 


FPMSWITCH FPMZSYNC 
FPMTERM IDLE#OPS 
FPMTMCVT LOADTABL 
FPMTMDEQ MCDS//IN 
FPMTMENQ MCDS^PRC 
FPMTMHAL HDTXTBLE 
FPMUPMTU PATCH 
FPMUPTOX PCH02SRC 
FPMWAIT PCH03SRC 


PCHOASRC PCHIASRC 
PCH05SRC PCH15SRC 
PCH06SRC PCH26SRC 
PCH07SRC TPLCDU 
PCH08SRC XDOOOl 
PCH09SRC XDOOlO 
PCHIOSRC XD0020 
PCH12SRC XD0060 
PCH13SRC XDO990 
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Appendix I 
DR VARIABLE LIST 


Variable 


Description 


FILEID 

DRNUM 

MISSN_ID 

FAC 

_0D 

_ODYRMO 

DV 

ITR 

NTR 

QP 

REF 

P 

VER 


CP 

PB 

GO 

PR 

X 

BD 

BDYRMO 

S 

G1 

G2 

G3 

GA 

G5 

G6 

G7 

G8 

F 

PD 

G9 

D 

TN 

TNYRMO 

FN 

FNYRMO 


File ID, always "F" 

DR Nuiober 

Suffix (Mission Identifier) 

Reporting Facility 
Date Logged In (MM/DD/Y) 

Year-Month Logged In (YMM) 

Dir i>ant Version 

IBi asinittal Number 

NASA Iransmittal Number 

Verification Assignment for "Special" 

Reference CR/C®, Other 
Priority of DR 

Target Closure Code (Replaced by actual Build ID 
for 2 a,2B,2C,2D,2E,2F) 

Actual Closure Code (Meaning different for SD'. DRs) 

Pre-Build Assesss%nt Data 

Verification Assignment for Department HE3 

Pre-Build Assessment Reason 

T&O Closure Code 

Development Close Date (MM/DD/Y) 

Year-Mon*,h of Development Close Date 
Verification Status Data 

Verification Assignment for Department HF6 
Verification Assignment fOi Department HC9 
Verification Assignment for Department HG5 
Verification Assignment for department HR? 
Verification Assignment for Department Hf5 
Verification Assignment for Department HDA 
Verification Assignment for Department HF7 
Verification Assignment for Department HC8 
Change/New Identifier 
SDL Build Date 


Verification Assignment for Department HD7 
Title/Description 
IBM Transmittal Date (MM/DD/Y) 
var-Month of IBM Transmittal Date (YMM) 
NASA Transmittal Received Date (MM/DD/Y) 
Year-Month of NASA Transmittal Received 
Date (VMM). 
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Principle Function ID 
Verification Test Code ID 
Developaent Build Target ID 
Status of the DR 
Future System Closure Code 
Verification Baseline ID 
Program Name (SDL Only) 
Verification Closure Date 
Action Department 



Appendix J 
DR LEGEND 


FILE_ID — rile ID 
Always "F" 

DR_NUM — DR Number; a unique number for tracking purposes. 

MISSN_ID — Suffix (Mission Identifier): indi :ates applicable FSW 
systems . 

None=SDL 

A*Site/TwSt Unique Patch DRs 

B-PMD3 

C'ECL 

D-SSWl 

E=JSC Form 1541 (Rev Jun 75) 

F*Release 19 (Floor System STS-5) 

G-PMD2 

H*AOA 

J'Invalid Entry; there should be no entries of "J". 

K-KSC 

L=STS--1 FUP5/FLT (Flight System) 

M-STS-1 FUP4 (07/30 System for Field Users) 

N-Entry 

P-PMDl 

Q“Invalid Entry; there should be no entries of "Q". 
R-STS-2 (R18V21 Flight System) 

Rl-STS-2 (R18V11 Field System) 

R2-STS-2 (R18V12 Field System) 

R3-STS-3 (R18V30 Flight System) 

R4»STS-4 (R18V40 Flight System) 

R5“lnvalid Entry; there should be no entries of "R5". 
R9-OV-99 (R18V90 Field System) 

S-SSW2 

S1=SPF Release 1 
S2-SPF Release 2 
S6*SDL Release 36 
S7«SDL Release 37 
T-OFTl 

U*Entry '’.date 1 

V-Invali'i Sntry; there should be no entries of "V". 
W=STS-2 (R17V5) 

X-STS-1 FUPl (12/11 System for Field Users) 

Y*STS-1 FUP2 (03/19 System for Field Users) 

Z-STS-1 FUP3 (05/21 System for Field Users) 



FAC — Reporting Facility; OFT area initiating the DR. 
AAA“Avionics Architecture 

AASD“Avionics Application Software Development 
ASD“Avionics Software Development 
ASSD“Avionics System Software Development 
B30- 

CI“Conf iguration Inspection 
CM*Control Monitor 
CSC“Computer Sciences Corporation 
CSD“Charles Stark Draper Laboratory 
CSDL«Charles Stark Draper Laboratory 
CT-Communi cat ions and Tracking 
C3= 

DL“Downl ist 
DSL= 

FACC“Ford Aerospace Cotsmunications Corporation 
FCO-Flight Computer Operating System 
FCOS'Flight Computer Operating System 
FIT=Flight Computer Interface Tester 
FNC= 

FSL“Flight Systems Laboratory 

FSW“Flight Software 

GBS^^Ground Based Shuttle 

GNC*Guidance , Na''igation & Control 

GNCC'Cuidance, Navigation L Control — Ex/Seq/Guid 

GNCD-Guidance, Navigation & Control “Navy & Spec Proc 

GNCE“Guidance, Navigation & Control — Fit Control Rm 

GNCO“Guidance, Navigation & Control 

HC2-=IBM Department 

HC8“IBM Department 

HEl-IBM Department 

HE8-IBM Department 

HF9“IBM Department 

HG8"IBM Department 

HHB"IBM Department 

HHS-IBM Department 

HH4*IBM Department 

HH5>IBM Department 

HH6-IBH Department 

HH7-IBM Department 

HH8“IBM Department 

HR7-IBH Department 

I* 

IBM'International Business Machines 
IT- 

I2“lntermetrics Inc. (HAL) 

JAI*Jef ferson Association Inc. 

KSC“Kennedy Space Center 
LEC"Lockheed 

MDAC'McDonnel 1 Douglas Aircraft Co. 

MDC“McDonnel 1 Douglas Co. 
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MDTS- 

MOD- 

MRI“MRI (Subcontractor) 

NAS'National Aerospace Systen 

NASA'National Aeronautics & Space Administration 

OAS“Orbiter Avionics Software 

OFT-Orbital Flight Test 

OPE“IBM Operations 

OPER“Operations 

OPB-RTCC Operations 

OWE-IBM (Owego, NY) 

OWEG-IBM (Owego, NY) 

PDAD- 

PL*Payload 
PO”Project Office 
RA~Requirements Analysis 
RI“Rscord ID 

RKS“Remote Manipulator System 
RTCC“Real Time Computer Complex 
S L' 

SAI”Shuttle Avionics Integration Laboratory 
SAIL“Shuttle Avionics Integration Laboratory 
SC”System Control 

SDL“Software Development Laboratory 
SDR«Software Design Requirements 
SDRD= 

SDRO- 

SFC'Select ion Filter Control 

SFO» J 

SFS-Shuttle Flight Support , ' 

SFSG-Shuttle Flight Support— GNC 

SFSS-Shuttle Flight Support— SSW,VU.SM,DL, RMS 

Sl*System Integration 

Sl’J’System Integration Deoartment 

SH/P°Systems Management/Payload Management 

SMD“Sys terns Management Development 

SMP-SM Offline 

SMPL-SM **ayload 

SMS“Shuttle Mission Simulator 

SPFl”Sof tware Production Facility 1 

SSI>*Spacecraf t Software Division 

SSW^System Software 

ST-Stats 

SID- 

T+0“Test & Operations 
T+0"*Test & Operations 
T4iO"Test & Operations 
T/0“Test it Operations 
TRW- TRW 
TSO- 

Ul-User Interface 
VCO-Vehicle Checkout 
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VER-IBM Verification Personnel 
VU-Vehicle Utility 
8 . 1 - 


_0D — Date logged in (Wt/DD/Y) ; date DR is entered into data base by 
Project Office. 

_ODYRMO ” Year-Month logged in (YMM) 

DV — Discrepant Version; floor version on which the discrepancy was 
observed. 

ITR — IBM Transmittal Number 
NTR — NASA Transmittal Number 

GA — Verification Assignment for "special"; used to identify DRs 
requiring signoff by Tony Macina (4A,4B) or Rich Cucco (3F) . 

REF — Reference CR/OR other; reference area for a related DR, PCR, 

PCA, or PTR. 

P — Priority of DR (for scheduling purposes) 
l=Critical 

2- Desirable 

3- Proposed Disposition 

4- Dispositioned for Future Build 

5- Dispositioned for No Mod or No DR Closure 

9-User note; these are not discrepancies, but this variable was 
used to track them as if they were. 

VER — Target Closure Code (Replaced by actual Build ID for 
2 a, 2B, 2C, 2d, 2E, 2F) . Implemented version; Build 
release/version number of DR fix or other closure. (No Mod, 

Dup DR, Etc.) 

AWP-Old SDL Closure Code 
CODE RVW-Code Review 
COSTLY 

CR-Change Request Required 
CR REQ-Change Request Required 
CR REQD-Change Request Required 
DOC-Docuaentation Error 
DOC ERR-Documentation Error 
DUP DR-Duplicate DR 
DLFDR-Dupl icate IMl 
DUPE-Duplicate DR 
DUPE DR-Duplicate DR 
DUPEDR-Duplicate DR 
EOS-Enhanced Operation System 
H/D-Hardware Error 
H/W-Hardware Error 
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H/W ERR^Hardware Error 

HDW^Hardware Error 

HRDWR'*Hardware Error 

HRWR^Hardware Error 

I/O ERR* Input /Output Error 

INS INFO*Insu£f icient Information 

INVALID 

JCL ERR=Job Control Language Error 
KP ERR-Old SDL Closure Code 
M0D*01d SDL Closure Code 
M0DE*01d SDL Closure Code 
M0DED*01d SDL Closure Code 
N/A=Not Applicable 
NO DATA 
NO DR 

NO H/W=Not Hardware 
NO HW=Nol Hardware 
NO MOD“No Mod 
NO MODE=No Mod 
NO MODS=No Mod 
NO REQ 

NOMOD*No Mod 
NOT H/W=Not Hardware 
NOT HDW=Not Hardware 
NOT OPER=Not Operator 
OP ERR“Operator Error 
OP NOTE=Operator Note 
OPER“Operator Error 
OPER ERR*Operator Error 
OPERR=Operator Error 
PATCH 

PRCCHG=01d SDL Closure Code 

PROC“Processing 

REPAIR 

RL N0TE*01d SDL Closure Code 
S/W=Sof tware 
SSWl*Systein Software 1 
SYS DL*01d SDL Closure Code 
SYS DLT*01d SDL Closure Code 
UNKNOWN 

US ERR“User Lrror 
US NOTE-User Note 
USEERR“User Error 
USER ER“User Error 
USER ERR-User Error 
USERR“User Error 
USR ER”User Error 
USR ERR-User Error 

CP — Actual Closure Code (meaning different for SDL DRs) . 
OFT CP - DR Categorization 
l*Under Investigation 
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lA^Suf f icient Data 
IB^Insuff icient Data 

IC'Insufficient Data - Unable to Recreate 
lD*Insui£icient Data/Too Costly to Recreate 
2“Fix Closure 
2A“Source Mod 
2B-Patch 

2C'*Patch and Release Note 
2D«I-Load Patch 
2E*PSF I-Load Corrections 
2F-Build/GFE/MMU Mod 
3"No DR Closure 

3A*User Error or No Requirement or Not Applicable 
3A**“User Error; ** indicates NASA SSD concurrance 
3B“Du'plicate DR 

3C°CR Required (New Requirement) 

3D*CR Required (Make Req. Match Code) 

3E“Hardware/Set Up/Support Software 
3F*User note 

3F***User note; ** indicates NASA SSD concurrance 
3F*P“User Note for Non-Flight System 
3F-X“U"User Note (same as 3F, "-X“U" is an error) 

3G”User's Guide 

3J"GFE Error/NASA Generated Opnote Required 
3K'GFE Error/Source or Patch Peq 
A»No Mod Closure 
AA«Waiver 

^B^Waiver and Op Note 

4B ,X"W“Waiver and Op Note (^ame as 4B, ",X“W»" is an error) 
4C*=Program Standards or Philosophical Issue or Fix at Next 
Opportunity when Module Opened for other CR or DR 
Implementation. 

AD'No Fix/Release Note 

4DF“*"No Fix/Release I'ote (same as 4D, is m error) 

4E“Insuff icient Data 

AF^Unexplained Anomaly 

4G“Requirement Intentions Met 

4H~Waiver and Users Guide 

4l“Function No Longer Used 

5“System No ' .■ >er Supported 

5A*System T ed 

6"Unsupportt •unction 

6A“Development Action Deferred to Next System 
6B~Verif ication Action Deferred From Previous System 
SDL CP - Computer Program End Item (CPE7) Name 
ALL- 
APASM- 

APES-i'dvanced Processor Emulator System 
ASC”*rfcent 

ASM-AP-101 Assembler 

AUTO-Automatic 

BLD- 
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CA- 

CB- 

CDC- 

CF- 

CF/UA- 

COM- 

COMM- 

COMR- 

COR- 


CSC**Computer Sciencei Corporation 

CSECT 

DASS« 


DPS'Data Processing Subsystem 

EOS'^Enhanced Operating System 

FC“Flight Computer 

FDH- 

FDSW- 

FDA- 

FEID-Flight Equipment Interface Development 
FSW-Flight Software 
FSWl2»Flight Software Release 12 
FSW13-Flight Software Release 13 
FSWIA-Flight Software Release lA 
FSWlS-Flight Software Release 15 
FSW16“Flight Software Release 16 
FSWl7-Flight Software Release 17 
GBS- 
GEMINI 


HAL-High-Order Aerospace Language 

HAL/S-High-Order Aerospace Language/Shuttle 

HALS-High~Order Aerospace Language /Shut tie 

HDW-Hardware 

HF2-IBM Department 

HH5-IBH Department 

HH8“IBM Department 

IBM- International Business Machines 

ICS-Interpretive Computer Simulator 

IR-lnner Roll 

I2-Intermetr ics Inc. (HAL) 

LE-AP-101 Linkage Editor 
LEC-Lockheed 


MMB- 

MMP- 

MMU-Mass Memory Unit 

MO- 

MOD- 

MVS-Middle Value Select 
NAS-National Aerospace System 

NASA-National Aeronautics & Space Administration 
OBS-On Board Software 

OFTIS-Orbi tal Flight Test Integrated System 
OFT15- 
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OS- 

oss- 

OTH- 

PMF-Program Management Facility 
PP-Pla'.form Positioning 
REQ-Requi rement 
RF/IS- 

SDL-Software Development Laboratory 

SDLOl 

SDL5 

SDL6 

SDL7 

SDL8 

SDL9 

SDL 10 

SDL 11 

SDL 12 

SDL13 

SDLIA 

SDL 15 

SDL 16 

SFT- 

SIM-Simulator 

SIS-SAIL Interface System 

SISO-Space Informations Systems Operations 

SM2- 

SODA- 

SOLID- 

SPMD-Sof tware Performance Monitoring Device 

TAPE 

TEK- 

TMS- 

TSO- 

UA- 

VA- 

lOl-HAL/AP-101 Compiler 

11.7- 
12 = 

12.A- 

12.5- 

12.7- 

12 . 8 - 
12.9- 
13- 
35- 
36.0- 

360-HAL/j 60 Compiler 

PB — Pre-build Assessment Data; Code changes detected earlier than 

Build. Used to track DRs against pre-builc process (design/code 
inspection and unit test). 

***-Has not yet been assessed. 
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C~DR should have been found by code inspection. 

D~DR should have been found by design inspection. 

T~DR should have been found by unit test. 

OOO^DR should not have been found before build. 

GO — Verification assignment for Dept. HE3 
The first character is a status. 

P“Primary 
S'Secondary 
C“Close 1 
J“Joint 

The second character indicates a specific test analyst. 

PR -- Pre-Build Assessment Reason; reason found test. 

X — T&O Closure Code; Test & Operations applicability to pass areas 1, 
2, and 3. The three positions represent the three mass memory 
areas . 

For non-code change dispositions: 

Blank^Not Applicable to Area 

N'No DK 

W-Waiver 

0“0pen 

P*Patch 

R’^Release Note 
S**Source Mod 
D'System Deleted 
U*User note 
For code fix: 

A "P" in each position indicates that the DR was patched in that 
area of mass memory. 

BD — Development Close Date (MM/DD/Y) ; Release/Target date. 

Target is projected date of fix (MM/DD) 

Release is date of build or other type of closure (MM/DD/Y) 

BDYRMO — Year-Month of Development Close Date 
o — Verification Status Data 

Used by Tony Macina & Verification for waiver correlation. 

V — Verification Status Data 

Useo by Tony Macina & Verification for waiver correlation. 

G1 — Verification Assignment for Dept. HF6 

Dept. HF6 is a department within the Avionics Software 
Verification Dept., which reviews GN&C IWs. 

The first character is a status: 

P“Pr imary 
S~Secondary 
enclosed 
J“ Joint 


- 80 - 



The eecond character indicates a specific test analyst. 

— Verification Assignment for Dept. HC9 

Dept. HC9 is a department within the Avionics Software 

Verification Dept., which reviews GN&C DRs. 

The first character is a status: 

P*Primary 

S*Secondary 

enclosed 

J“Joint 

The second character indicates a specific test analyst. 

— Verification Assignment for Dept. HG5 

Dept. HG5 is a department within the Avionics Sofiware 

Verification Dept., which reviews GN&C DRs. 

The first character is a status: 

P“Primcry 
S“Secondary 
C*C.' 08 ed 
J“Joint 

The second character indicates a specific test analyst. 

— Veiification Assignment for Dept. HB7 

Dept. HB7 is a depart^ient within the Avionics Software 

Verification Dept., which reviews GN&C DRs. 

The first character is a status: 

P“Primary 

S“Secondary 

C“Closed 

J*Joint 

The second character indicates a specific test arnlyst. 

— Verification Assignment for Dept. HF5 

Dept. HF5 is a department within the Avionics Software 

Verification Dept., which reviews System Service DRs. 

The first character is a status: 

P*Primary 

S*Seconda»'y 

C“Closed 

J“Joint 

The second characte.* indicates a specific test analyst. 

— Verification Assignment for Dept. HDA 

The first character is a status: 

P“Primary 

S'Secondary 

enclosed 

J"Joint 

The second character indicates a specific test analyst. 

— Verification Assignment for Dept. HF7 

Dept. HF7 is a department within the Avionics Software 



M 4 m.r 


K 


Verification Dept., which reviews Peiiforunce Mti. 

The first character is a status: 

P*Primary 

S“Secondary 

^ enclosed 

J" Joint 

The second character indicates a specific test analyst. 

» ! 

G8 — Verification Assignment for Dept. HC8 i 

Dept. HC8 is a department within the Avionics Software 
ig Verification Dept., which reviews Performance DRs. ; 

The first character is a status: 

P“Primary 

S-Secondary 

enclosed 

J“Joint 

The second character indicates a specific test analyst. 

F — Change/New Identifier 

^■indicates changes since previous run. 

N“New 

PD -- SDL Build Date 

G9 — Verification Assignment for Dept. HD7 
The first character is a status: 

P“Primary 

S“Secondary ' » 

C-Closed 

t J“Joint 

The second ch.:racter indicates a specific test analyst. 

D — Title/Description; condensed descriptioi- of pr<'blem. 

TN -- IBM transmittal date (MM/DD/Y) 

TNYRMO — Year-Month of IBM transmittal date (YMM) 

FN — NASA transff-ttal received date (MM/DD/Y) 

FNYRMO — Year-Month of NASA transmittal received date (YMM) 

PF — Principle Function Id 
Not Used 

TC — Verification Test Code ID 

TD — Development Build Target ID; Development target date (MM/DD) 

ST — Status of the Wl. 
enclosed 

CC*Closed by rSW and Verification 
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CP~Clot«d with a patch 
D'Varif ication Action Dafarrad 
F“Fixad (SDL only) 

M>Cou.poaite Hovar (SDL) 

N**Awaiting NASA/SSD approval 
0“0pen 

OI~Plannad devalcpnant work will close the DR or applicability 
OFT is uncartain. 

ON~Open with an OP note written 

0P"0pan patched 

T“In system test (SDL) 

V'Awaiting verification approval 
VO~Waiting Closure Description 

VX^Closcd by Development; Awaiting review by Nacina or Cucrr>. 
X-Dusuny Status used on entries for page control. 

IMF — Future System Closure Code; Used by verification to i- ic^*^e how 
the DR is being closed on the next system. 

BL — Verification Baswllne ID; Used by verification fc* budgeting. 

Vihen a DR uas been included in 9 man-power estimate, this is set. 
The "blank" DRs indicate costs over the "baseline". 


PN — Program Name (SDL only) 

VC — Verification Closure Date 


AD — Action Department; OFT area responsible for fi>.. 

AASD-Avionics Application Software Development 
ASA-Avionics Software Arch/Sys Analysis 
ASD- 

ASSD^Avionics System Srftware evelopment 

C71- 

DASS- 


DDl^Discrete Digital Input.' 

DL"Downlist 

D/L**Deorb it /Landing 

£K- 


EOS^Enhanced Operating System 
FCOS"FLT Computer Operating System 


FEffl- 

FSW-Fl 

GNC-Gui 

GNC\-Gu 

GNCB-Gu 

GNCC-Gu 

GNCD-Gu 

CNCE-Gu 

GNCF-Gu 

GN&C"Gu 

GNCO-Gu 

GNCl-Gu 


gnt Software 
darce, Navigati 
idance, Navigat 
idance, uavigat 
idance, Navigat 
idance, Navigat 
idance, Na igat 
idance, Navigat 
idance, Navigat 
idance, N'<«''i gat 
idance, Navigat 


on and Control 
ion and Control 
ion and Control 
ion and Control 
ion and Control 
ion and Control 
ion and Control 
ion and Control 
ion a.td Control 
ion and Control 


Display 
Ex/S«q/Guid 
Nav & Stec Prvi 
rJt Cntrl/RM 
I loads 
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GNC2~Guidance, Navigation and Control 

HDW-Hardware 

HD7-IBM Department 

HE9*IBM Department 

HF1*IBH Department 

HF2>IBH Department 

HF7-IBM Department 

HF9'*IBH Department 

HG7'‘IBH Department 

HG8*IBM Department 

HH4-IBM Department 

HHS'IBH Department 

HH6*IBH Department 

HH7“IBM Department 

HHS'IBM Department 

HH9*IBM Department 

HK9‘IBM Department 

HR2“IBM Department 

H/W-Hardware (EOS) 

I2=Intermetrics Inc, (HAL) 

KSC“Kennedy Space Center 

OPE*IBM Operations 

OPER'Operations 

OSS- 

OTH- 

OWEG-IBM (Owega, NY) 

PRC-Procedures (EOS) 

PROC-Procedures 
PYLD-Payload 
RA-Requirements Analysis 
RMS-Remote Manipulator System 
RQR-Requirements 
SC-System Control 

SDL-Software Development Laboratory 

SFSG-Shuttle Flight Support - GNC 

SFSS-Shuttle Flight Support - SSW, VU,SM,DL,RMS 

Sl-System Integration 

SID-System Integration 

SM-Sys terns Management 

SMP-SM Offline 

SMPL-SM Payload 

SS*Systems Software 

SSCT-Top Level Design Team 

SSH-System Software 

SW-Software 

SYSA-Systems Analysis Group 
S/W-Software (EOS) 

Tape 

T+O-Test & Operations 
T&O-Test & Operations 
Ul-User Interface 
yCO-Vehicle Checkout 
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VU-VehicU Utility 
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Appendix K 
CR VARIABLE LIST 


Variable Description 


FILE ID 

File ID, always "P" 

PCR NUM 

PCR Number 

CR NUM 

CR Number 

CRREV ID 

CR Revision ID 

OASCB EF 

OASCB Effectivity 

RRBDT 

RRB Disposition Date (MM/DD/Y) 

RRBYRMO 

Year-Month of RRB Disposition (YMM) 

CCBDDT 

CCB Disposition Date (MM/DD/Y) 

CCBYRMO 

Year-Month of CCB Disposition (YMM) 

OASCBDT 

OASCB Disposition Date (MM/DD/Y) 

OASCB YRM 

Year-Month of OASCB Disposition (YMM) 

RRBDIS 

RRB Disposition 

CCBDIS 

CCB Disposition 

OASCBDIS 

OASCB Disposition 

DEPTl ID 

Department 1 ID 

DEPT2 ID 

Department 2 ID 

DEPT3 ID 

Department 3 ID 

DEPT4 ID 

Department A ID 

DEPT5~ID 

Department 5 ID 

DEPT6 ID 

Department 6 ID 

depttIid 

Department 7 ID 

DEPTl VT 

Department 1 Vote 

DEPT2~VT 

Department 2 Vote 

DEPT3~VT 

Department 3 Vote 

DEPTA VT 

Department A Vote 

DEPT5 VT 

Department 5 Vote 

DEPT6 VT 

Department 6 Vote 

DEPT7~VT 

Department 7 Vote 

BCB EF 

Baseline Control Board Effectivity 

DTRCCD 

Date Received 

YRMOREC 

Year-Month Received (YMM) 

FNLDIS 

Final Disposition 

PRCTL ID 

Print Control ID 

catcoSe 

Category Code 

BCBR16 

BCB Indicator for Release 16 

NNLSTSl 

Never-Never List Indicator for STS-1 

BCBR17 

BCB Indicator for Release 17 

NNLR17 

Never-Never List Indicator for Release 17 

BCBR18 

BCB Indicator for Release 18 
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NNLR18 

BCBR19 

NNLR19 

BCBR20 

NNLR20 

BCBR18_3 

BCBR18_A 

0V99SYS 

NAIN 

BFSIN 

RELINVER 

TITLE 

DlIMPYRl 

D1IMPYR2 

D1IMPYR3 

D11.*PYR4 

D2IMPYR1 

D2IMPYR2 

D2IMPYR3 

D2IMPYRA 

D3IMPYR1 

D3IMPYR2 

D3IMPYR3 

D3IMPYR4 

DAIMPYRl 

D4IMPYR2 

D41MPYR3 

DAIHPYRA 

D5IMPYR1 

D5IMPYR2 

D5IMPYR3 

D5IMPYRA 

D6INPYR1 

D6IMPYR2 

D6IMPYR3 

D6IMPYR4 

D7IMPYR1 

D7IMPYR2 

D71MPYR3 

D7IHPYRA 

DlTOTIMP 

D2TOTIMP 

D3TOTIMP 

D4TOTIMP 

D5TOTIMP 

D6TOTIW 

D7TOTIMP 

COMMENT 1 

COMMENT2 

VCOSl 


N«ver-N«ver Li«t Indicator for Roloato 18 
BCB Indicator for Ralaasa 19 
Novar-Navar Liat Indicator for Ralaaaa 19 
BCB Indicator for Ralaaaa 20 
Navar-Navar Liat Indicator for Ralaaaa 20 
BCB Indicator for Ralaaaa 18«30 (STS~3) 

BCB Indicator for Ralaaaa 18* AO (STS-A) 

BCB Indicator for OV99 Syataa 
Not Applicabla to Paaa Indicator 
BPS Only Indicator 

Ralaaaa 16, 17, 18, 19, 20 Indicatora, 

Varif ication 
Title 

Dapt. 1 Manpower laipact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dept. 2 Manpower Impact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dept . 3 Manpower Impact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dapt. A Manpower Impact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dept. 5 Manpower Impact ~ Year 1 

- Year 2 

- Year 3 

- Year A 

Dept. 6 Manpower Impact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dept. 7 Manpower Impact - Year 1 

- Year 2 

- Year 3 

- Year A 

Dapt. 1 Total Manpower Impact 

Dept. 2 Total Manpower Impact 

Dapt. 3 Total Manpower Impact 

Dept. A Total Manpower Impact 

Dapt. 5 Total Manpower Impact 

Dapt. 6 Total Manpower Impact 

Dapt. 7 Total Manpower Impact 

Comments (Part I) 

Comments (Part 2, Continuation of Part 1) 
Early Release Indicator for Vehicle Checkout 
System 
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VC0S2 

Early Release 
Systea //2 

VC0S3 

Early Release 
Systea #3 

PALMS 1 

Early Release 

SSI 

Early Release 

ENTRYCL 

Early Rele'^se 
(10/03/77) 

PALMS2 

Early Release 
(12/05/77) 

SS2 

Early Release 

AOA 

Early Release 
(02/06/78) 

PALMS3 

Early Release 
(03/06/78) 

'•:ntrys 

Early Release 
(05/01/78) 

KSCS 

Early Release 
(06/05/78) 

ENTRYUDl 

Early Release 
(07/03/78) 

OFTl FAC I 

Early Release 
(09/0A/78) 

R12 

Early Release 
(12/11/78) 

CYC2ILD 

Early Release 
(02/05/79) 

R13 

Early Release 

R14 

Early Release 

R15 

Early Release 


Indicator for Vahicle Chackout 

Indicator for VehicI* Checkout 

Indicator for Paladale Syatea #1 
Indicator for Systea Software ^1 
Indicator for Entry Closed Loop 

Indicator for Paladale Systea ^2 

Indicator for Systea Software #2 
Indicator for Abort Once Around 

Indicator for Paladale Systea y/3 

Indicator for Entry Systea 

Indicator for KSC Systea 

Indicator for Entry Update //I 

Indicator for OFTl FACI Systea 

Indicator for Release 12 

Indicator for Cycle 2 I-Loads 

Indicator for Release 13 
Indicator for Release 14 
Indicator for Release 15 
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Appendix L 
CR LEGEND 


FILE_ID — File ID 
Always "P" 

PCR_NUM — PCR Number; a unique number for tracking purposes. 

CR_NUM — CR Number; a unique number for tracking purposes. 

CRREV ID — CR Revision ID; reflects re-issues of change requests due 
to changes. 

A“First Reissue 
B'Second Reissue 
C“Third Reissue 
D“Fourth Reissue 
E^Fifth Reissue 
F*Sixth Reissue 
G=Seventh Reissue 
H=°Eighth Reissue 

OASCB_EF — Orbiter Avionics Software Control Board Effectivity; the 
Release ID of the mission the OASCB stated this CR was 
approved for. This fell into disuse when a separate 
board determined mission effectivity. 

ALT'Approach and Landing Test 
BLD- 

BOTH“Both ALT and OFT Missions 

DIT“Data ID Table 

EOS*‘Extended Operating System 

FEID~Flight Equipment Interface Development 

FRF“STS-1 Flight Readiness Firing 

IPL^Initial Program Load 

MIP- 

MMP^Mass Memory Procedureds Document CR 
N/A*°Not Applicable 
OFT-Orbital Flight Test 
OFTl-Orbital Flight Test 1 
OFT2-Orbital Flight Test 2 
OFT3-Orbital Flight Test 3 
OTHR“Non-Primary Avionics Software CR 
OV99'*Orbital Vehicle 99 Checkout System 
POFT-Post-OFT (Operational Shuttle) 

PRI*Primary Avionics Software CR 
PS-l-Patch Set 1 
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PS-2-Patch Set 2 
R-21'*Release 21 
ROM-Read Only Memory 
SCL- 

SDL-Software Development Laboratory 
SFS-Shuttle Flight Support 
SID-System Integration Department 
SPF-Software Production Facility 
SPF2-Software Production Facility 2 
SS-l-STS-1 Mission 
SS-2-STS-2 Mission 
SS-3-STS-3 Mission 
SS-6-STS-6 Mission 
SS-7-STS-7 Mission 

551- STS-1 Mission 

552- STS-2 Mission 
STS— STS Mission 
STSl-STS-1 Mission 
STS2-STS-2 Mission 
STS3-STS-3 Mission 
STS4-STS-A Mission 
STS5-STS-5 Pission 
STS6-STS-6 Mission 

V 19-Software Release 19 

V 21-Software Release 21 
V-05-Sof tware Release 5 
V-ll-Sof tware Release 11 
V-12-Sof tware Release 12 
V-16-Sof tware Release 16 
V-17-Sof tware Release 17 
V-18-Sof tware Release 18 
V-19-Software Release 19 
V-20-Sof tware Release 20 
V-21-Sof tware Release 21 
VERF-V erifi cation 
Vl8-Software Release 18 
V19-Software Release 19 

18- Software Release 18 (STS-3) 

19- Sofcware Release 19 (STS-5, STS~6) 

20- Software Release 20 (STS-7, STS~8) 

RRBDT — RRB Disposition uate (MM/DD/Y) 

RRBYRNO — Year-Month of RRB Disposition (YMM) 

CCBDDT — Change Control Board Disposition Date (MM/DD/Y) 
CCBYRMO — Year-Month of CCB Disposition (YMM) 

OASCBDT — OASCB Disposition Date (MM/DD/Y) 

OASCBYRM — Year-Month of OASCB Disposition (YMM) 
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RRBDIS — RRB Ditpoiition 
A~Approv«d 
D*DiBapprov«d 

N*Invalid Entry; Thart should be no entries of "N". 

R-Invalid Entry; There should be no entries of "R". 

W^Withdravm 

l*Invalid Entry; There should be no entries of "1". 

CCBDIS — CCB Disposition 
A^Approved 
D-Disapproved 
H^Withdrawn 

0-Invalid Entry; There should be no entries of "0". 

OASCBDIS — OASCB Disposition 
A-Approved 
D-Disapproved 
W-Withdrawn 

DEPT1_ID — Department 1 ID 

GNC-Guidance Navigation and Control 

GNC/C-Gui dance Navigation and Control — Ex/Seq/Guid 

DEPT2ID — Department 2 ID 
SM-Systems Management 

SM/PL-Systems Management/Payload Management 
SYS ANL-Systems Analysis 

DEPT3_ID — Department 3 ID 

FCOS/CI“Flight Computer Operation System/Configuration Inspection 
FCOS/UI-Flight Computer Operation System/User Interface 

DEPT4 ID — Department A ID 
VERIF-Verification 

DEPT5_ID — Department 5 ID 

SDL-Software Development Laboratory 

DEPT6_ID -- Department 6 ID 

SMP/DL-Systems Management Off line/Downlist 
SYS ANAL-Systems Analysis 
SYS ANL-Systems Analysis 

DEPT7_ID — Department 7 ID 

FEID-Flight Equipment Interface Development 
PL-Pay load 

SM/PL-Systems Management /Payload 

DEPT1_VT “ Department 1 Vote 

A-Approved by this Department 

C-Invalid Entry; There should be no entries of "C”. 

N-Not Applicable to this Department 
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0-Invalid Entry; There should be no entries of "0". 
R»Reject Current CR; Awaiting a Revision. 

U“Vote Pending 

W^Re commend Withdrawal 

DEPT2_VT — Department 2 Vote 

A*Approved by this Department 
N^Not Applicable to this Department 
R*Reject Current CR; Awaiting a Revision. 

U»Vote Pending 
W*Recommend Withdrawal 

DEPT3_VT — Department 3 Vote 

A*Approved by this Department 
N'Not Applicable to this Department 
R»Reject Current CR; Awaiting a Revision. 

U"*Votc Pending 
W'Recommend Withdrawal 

DEPTA_VT — Department A Vote 

A^Approved by this Department 
N*Not Applicable to this Department 
R-Reject Current CR; Awaiting a Revision. 

U“Vote Pending 
W*Recoinmend Withdrawal 

DEPT5_VT ~ Department 5 Vote 

A* Approved by this Department 
N*!1ot Applicable to this Department 
R*Reject Current CR; Awaiting a Revision. 

U»Vote Pending 
W^Recommend Withdrawal 

A-Invalid Entry; There should be no entries of "A". 

DEPT6_VT — Department 6 Vote 

A*Approved by this Department 
N**Not Applicable to this Department 
R“Reject Current CR; Awaiting a Revision. 

U*Vote Pending 
W^Recommend Withdrawal 

DEPT7_VT — Department 7 Vote 

A^Approved by this Department 
N^Not Applicable to this Department 
R»Reject Current CR; Awaiting a Revision. 

U“Vote Pending 
WoRecomnend Withdrawal 

BCB EF — Baseline Control Board Effectivity 
AC“Ascent 09/0A/78 Drop 
AOA-Abort Once Around 
ASC*Ascent 09/0A/78 Drop 




- 92 - 



M 




/ ' 


AU“Ascent Update 12/11/78 
BFS-Backup Flight System 
CY-3-Cycle 3 I-Load Update 
EC“Events Controller 
ECL*Entry Closed Loop 10/03/77 
ENT-Entry 05/01/78 
EUl-Entry Update //I 07/03/78 
EU2-Entry Update //2 09/04/78 
EU3“Entry Update #3 12/11/78 
GNC*°Gui dance, Navigation and Control 
KSC^Kennedy Space Center 
KCSU-VU/Downlist KSC Update 09/04/78 
N/A“Not Applicable 
NA'Not Applicable 

NNL*Never~Never List (ALT) ; Approved CRs that were not 
implemented. 

NNLl“Never-Never List (STS~1) ; Approved CRs that were not 
implemented. 

NNL2“Never-Never List (STS-2) ; Approved CRs that were not 
implemented. 

0C»0rbit Closed Loop 05/01/78 
0CL“0rbit Closed Loop 05/01/78 
OFTU-Orbital Flight Test Update 
OFTl-Orbital Flight Test 1 
ONLY- 

ORB-Orbit 09/04/78 

OU-Orbit Update 12/11/78 

0V99*0rbital Vehicle 99 Checkout System 

PDP=Payload Bay Door System 05/01/78 

PHDl-Palmdale #1 

PMD2-Palmdale //2 

PMD3-Palmdale #3 

RMSC-Early RMS Drop 

RMSD-Early RMS Drop 

R17-Release 17 

RlS'Release 18 

R19*Release 19 

R21-Release 21 

R36-01d SDL Release 36 

SMC- 

SMC3- 

SM2- 

SS-l-STS-1 Mission 

SS-2-STS-2 Mission 

SSC- 

SSC3- 

SSWl- 

SSW2- 

SS1+- 

SSIC- 

SS2C- 

STS2-STS-2 Mission 


- 93 - 



STS3-STS-3 Million 
STS4-STS-4 Million 
STS5-STS-5 Mission 
STS6-STS-6 Mission 
STS9-STS-9 Mission 
TBS- 

V-18“Sof tware Release 18 
V-19-Software Release 19 
V-20“Sof tware Release 20 
V-21*Software Release 21 
VCAN- 

VCl-Vehicle Checkout y/1 
VC2“Vehicle Checkout ijf2 
VC3“Vehicle Checkout #3 
OFTU-OFT (STS-1) Update 12/11/78 
10. 0“Sof tware Release 10.0 
10. l“Sof tware Release 10.1 

DTRECD — Date Received 

YRMOREC • Year-Month Received (YMM) 

FNLDIS — Final Disposition 
APPRO VD" Approved 
DISAPP-Disapproved 
DISAPPV-Disapproved 
WITHDRN-Withdrawn 


PRCTL_ID — Print Control ID 

90«=Used to suppress printing of a record for "current record" 
reports . 

CATCODE — Category Code 
CONCE- 

FO/FS“Fail Operational/Fail Safe Study 
PCRC- 

REQ~Requirenents 
RE0MT“Requirements 
SCRUB“Scrub Library 

02/26/lD“Inval id Entry; There should be no "02/26/lD" entries. 

03/04/lA“Inval id Entry; There should be no "03/04/lA" entries. 

03/0A/lD“lnval id Entry; There should be no "03/04/lD" entries. 

03/04/lW’>Inval id Entry; There should be no "03/04/lW" entries. 

BCBR16 — Baseline Control Board Indicator for Release 16 
B"T^is CR Appears on BCB 5110 Listings. 

NNLSTSl “ Never-Never List Indicator for STS-1. Never-Never lists 
provide accounting for CRs that were approved, but never 
implemented. 

*“This CR appears in Never-Never list. 

N”This CR appearc in Never-Never list. 
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BCBR17 ■ 
NNLR17 • 

BCBR18 
NNLR18 • 

BCBRi9 • 
NNLR19 ■ 

BCBR20 

NNLR20 

BCBR18_ 
BC3R18_ 
OV99SYS 
NAIN — 


- Baseline Control Board Indicator for Release 17 

B^This CR Appears on BCB 5110 Listings 

V-Invalid Entry; There should be no "V" entries. 

- Never-Never List Indicator for Release 17. Never-Never 
lists provide accounting for CRs that wei'e approved, but 
never implemented. 

*“This CR appears in a Never-Never uist. 

N“This CR appears in a Never-Never List. 

- Baseline Control Board Indicator for Release 18 

B~This CR Appears on BCB 5110 Listings. 

- Never-Never List Indicator for Release 18. Never-Never 
lists provide accounting for CRs that were approved, but 
never implemented. 

*“This CR appears in a Never-Never List. 

N“This CR appears in a Never-Never List. 

- Baseline Control Board Indicator for Release 19 

B“This CR Appears on BCB 5110 Listings. 

- Never-Never List Indicator for Release 19. Never-Never 
lists provide accounting for CRs that approved, but never 
implemented. 

*“This CR appears in a Never-Never List. 

N“This CR appears in a Never-Never Li. 

-- Baseline Control Board Indicator for Release 20. 

B“This CR Appears on BCB 5110 Listings. 


- Never-Never List Indicator for Release 20. Never-Never 
lists provide accounting for CRs that were approved, but 
never implemented. 

*“This CR appears in a Never-Never List. 

N“This CR appears in a Never-Never List. 


— Baseline Control Board Indicator for Rel' se 18.30 
(STS-3) 

B"This CR Appears on BCB 5110 Listings. 


■ — Baseline Control Board Indicator for Release 18.40 
(STS-4) 

B~This CR Appears on BCB 5110 Listings. 


— Baseline Control Board Indicator for Orbital Vehicle 99 
Checkout System. 

B'This CR Appears on BCB 5110 Listings. 


Not Applicable to Pass 
D"Invalid Entry; There 
M“lnvalid Entry; There 


Indicator 
should be no "D" 
should be no "M" 


entries . 
ent ies. 


A 
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N^Invalid Entry; There ehould be no "N" entries. 
P^Invalid Entry; There should be no "P" entries. 

1- DIT 

2- OTT 

3- VEH ONLY 
A-IPL 

5- GMEM R/W 

6- MIP 

7- BFS 

8- DLL 

9- MI SC 

BFSIN — Backup Flight System Only Indicator 

*-This CR is applicable to Backup Flight System only. 

RELINVER — Release 16,17,18,19,20 Indicators - Ver if ic'>t ion 
B'This CR Appears in BCB 5110 Data Base. 

V>This CR Appears in Verification CR Data Brse. 

TITLE — Title 


DlIMPYRl 

— 

Department 

1 

Manpower 

Impact 

— 

Yoar 

D1IMPYR2 

— 

Department 

1 

Manpower 

Impact 

- 

Year 

D1IMPYR3 

— 

Department 

1 

Manpower 

Imp'jict 

- 

Year 

DIIMPYRA 

— 

Department 

1 

Manpower 

Impact 

- 

Year 

D2IMPYR1 

— 

Department 

- 

Manpower 

Impact 

- 

Year 

D2IMPYR2 

— 

Department 

2 

Manpower 

Impact 

- 

Year 

U2IMPYR3 

— 

Department 

2 

Manpower 

Impact 

- 

Year 

DIIMPYRA 

— 

Department 

2 

Manpower 

Impact 

- 

Year 

D3IMPYR1 

— 

Department 

3 

Manpower 

Impact 

- 

Year 

D3IMPYR2 


Department 

3 

Manpower 

Impact 

- 

Year 

D3IMPYR3 

— 

Department 

3 

Manpower 

Impact 

- 

Ye'^r 

D31MPYRA 

— 

Department 

3 

Manpower 

Impact 

- 

Year 

DAIhPYRl 

— 

Department 

A 

Manpower 

Impact 

- 

Year 

DAIMPYR2 

— 

Department 

A 

Manpower 

Impact 

- 

Year 

DAIMPYR3 

— 

Department 

A 

Manpower 

Impact 

- 

Year 

DAIMPYRA 

— 

Department 

A 

Manpower 

Impact 

- 

Year 


1 

2 

3 

A 

1 

2 

3 

A 

1 

2 

3 

A 

1 

2 

3 

A 



p 





D5IHPYR1 — Department 5 Manpower Impact - Year 1 

D5IMPYR2 — Department 5 Manpower Impact - Year 2 

D5IMPYP'' — Department 5 Manpower Impact - Year 3 

D5IMPYRA — Department 5 Manpower Impact - Year 4 

D6IMPYR1 — Department 6 Manpower Impact - Year 1 

D6IMPYR2 — Department 6 Manpower Impact - Year 2 

D6IMPYR3 — ''"partment 6 Manpower Impact ~ Year 3 

D6IHPYR4 — Depat tment 6 Manpower Impact - Year 4 

D7IMPYR1 — Department 7 Manpower Impact - Year 1 

D7IMPYR2 — Department 7 Manpower Impact - Year 2 

D7IMPYR3 — Department 7 Manpower Impact - Year 3 

D7IMPYR4 — Depa. Loent 7 Manpower Impact - Year 4 

DlTOTIMP — Department 1 Total Manpower Impact 

D2T0TIMP — Department 2 Total Manpower Impact 

D3T0TIMP — Department 3 Total Manpower Impact 

D4T0TIMP — Department 4 Total Manpower Impact 

D5T0TIMP — Department 5 Total Manpower Impact 

D6T0TIMP — Department 6 Total Manpower Impact 

D7T0TIMP — Department 7 Total Manpower Impact 

COMMENTl -- Comments (Part 1) 

C0MMENT2 — Comments (Part 2, Continuation of Part 1) 

VCOSl — Early Release Indicator for Vehicle Checkout System //I. 
*>This CR Appears in BCB 5110 Data Bases 
C“This CR Appears in old BCB Charts 
D*This CR Appears in Development Plans Only 

VC0S2 — Early Release Indicator for Vehicle Checkout System //2. 
**This CR Appears in BCB 5110 Data Bases 
C'This CR Appears in old BCB Charts 
D^This CR Appears in Development Plans Only 
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VC0S3 — Early Release Indicator for Vehicle Checkout System 03 . 
*~This CR Appears in BCB 5110 Data Bases 
C'This CR Appears in old BCB Charts 
0*=This CR Appears in Development Plans Only 

PALHSl — Early Release Indicator for Palmdale System 01 . 

’^■■This CR Appears in BCB 5110 Data Bases 
C“This CR Appears in old BCB Charts 
D-This CR Appears in Development Plans Only 

551 — Early Release Indicator for System Software 01 . 

**This CR Appears in BCB 5110 Data Bases 
C'*This CR Appears in old BCB Charts 
D“This CR Appears in Development Plans Only 

ENTRYCL — Early Release Indicator for Entry Closed Loop (10/03/77) 
*'=This CR Appears in BCB 5110 Data Bases 
C“This CR Appears in old BCB Charts 
D~This CR Appears in Development ^lans Only 

PALMS2 — Early Release Indicator for Palmdale System 02 (12/05/77) 
*~This CR Appears in BCB 5110 Data Bases 
C~This CR Appears in old BCB Charts 
D^This CR Appears in Development Plans Only 

552 — Early Release Indicator for System Software 02 

*~This CR Appears in BCB 5110 Data Bases 
C-'This CR Appears in old BCB Charts 
D~This CR Appears in Development Plans Only 

AOA — Early Release Indicator for Abort Once Around (02/06/78) 
*~This CR Appears in BCB 5110 Data Bases 
C'This CR Appears in old BCB Charts 
D^This CR Appears in Development Plans Only 

PALMS3 — Early Release Indicator for Palmdale System 03 (03/06/78) 
*‘This CR Appears in BCB 5110 Data Bases 
C^This CR Appears in old BCB Charts 
D*=This CR Appears in Development Plans Only 

ENTRYS — Early Release Indicator for Entry System (05/01/78) 

*“Thi8 CR Appears in BCB 5110 Data Bases 
C'This CR Appears in old BCB Charts 
I>*This CR Appears in Development Plans Only 

KSCS — Early Release Indicator for KSC System (06/05/78) 

*~This CR Appears in BCB 5110 Data Bases 
C'This CR Appears in old BCB Charts 
D^This CR Appears in Development Plans Only 


ENTRYUDl — Early Release Indicator for Entry Update 01 (07/03/78) 
**'This CR Appears in BCB 5110 Data Bases 



C^This CR Appears in old BCB Charts 
D^'This CR Appears in Development Plans Only 


OFTlFACI — Early Release 
*=This CR Appears 
C=This CR Appears 
D=This CR Appears 


Indicator for OFTl FACI System (09/04/78) 
in BCB 5110 Data Bases 
in old BCB Charts 
in Development Plans Only 


R12 — Early Release Indicator for Release 12 (12/11/78) 
*“This CR Appears in BCB 5110 Data Bases 
C°This CR Appears in old BCB Charts 
D=This CR Appears in Development Plans Only 


CYC2ILD — Early Release Indicator for Cycle 2 I-Loads (02/05/79) 
*=This CR Appears in BCB 5110 Data Bases 
C=This CR Appears in old BCB Charts 
D=This CR Appears in Development Plans Only 

R13 — Early Release Indicator for Release 13 

*=This CR Appears in BCB 5110 Data Bases 
C=This CR Appears in old BCB Charts 
D=This CR Appears in Development Plans Only 

R14 — Early Release Indicator for Release 14 

*=This CR Appears in BCB 5110 Data Bases 
C=This CR Appears in old BCB Charts 
D=This CR Appears in Development Plans Only 

R"" — Early Release Indicator for Release 15 

*~This CR Appears in BCB 5110 Data Bases 
C“This CR Appears in old BCB Charts 
D“This CR Appears in Development Plans Only 



Appendix N 
COST DATA CHARTS 


Data, provided by IBH, pertaining to costs for developnent and verifica- 
tion were examined. Data were plotted over time using monthly and cumu- 
lative values to observe how the amount and rate of spending changed 
over time. Change data were also plotted in conjunction with cost data 
to visualise how they changed concurrently. 
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Figure 3: 


Total hours IBM billed for verification. 
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Figure A; Cumulative total man-hours IBM billed NASA for development. 
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Figure 6: 


Development and verification cost with scaled change and 
discrepancy reports frequency. 
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Appendix N 
CHANGE DATA CHARTS 


The change data bate consisted of change and discrepancy reports. Fre- 
quency of selected variables over tine and values of variables were 
plotted in an effort to determine what data were available and their 
generwl characteristics. Two or nore variables were used in some plots 
to get a better understanding of the data. 
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Figure 7: Frequency of DR’s logged in by year-month. 
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Figure 8: Frequency of DR’s for mission identifier (MISSN_ID) 
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Figure 10: DR frequency for action department (AD). 
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Figure 12; DR f-equency for status (ST) . 
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Figure lA; 


Frequency of priority 1 DR's logged in by year-month 
( ODYRMO). 
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Frequency of priority 2 DR's logged in by year“month 
( ODYRMC). 
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Figure 16: 
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Figure 17: Frequency of priori»-y A DR's logged in by year-month 

( ODYRMO) . 
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Figure 18: Frequency of priority 5 DR's logged in by year-month 

( ODYRMO). 
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Figure 19: Frequency of priority 9 DR's logged in by year-month 

( ODYRMO). 
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Fifore 22; Frequency of priority 1 DR's from a reporting facility 
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Figure 23: Frequency of priority 2 DR's from a reporting facility 

(FAC) . 
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Figure 24: Frequency of priority 3 DR's from a reporting facility 

(FAC) . 
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Frequency of priority 5 DR’s from a reporting facility 
(FAC) . 
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Number of DR's logged for release 19, floor system STS-5 
(MISSN 1D»F). 
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Figure 35: Number of DR’i logged for PMD2 (MISSN_IO»G) . 
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Figure 36: Number of DU's logged for AOA (M1SSN_ID“H) . 
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Figure 38: Number of DR's logged for STS-1, FUP5/FLT (MISSN ID*L) , 
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Figure 40; Number of DR's logged for entry (MISSN 1D*N) 
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Figure A3; Number of DR's logged for STS~2, RlBVll field system 
(MISSN_ID'R1) . 
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Figure A5: Number of DR's logged for STS-3, R18V30 flight system 

(MISSN_ID-R3) . 
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Figure A6: Number of DR's logged for STS-4, R18VA5 flight system 

(MISSN_ID»R4) . 



ORIGINAL PAGE IS 
OF POOR QUALITY 


llfr- 

IHH 

IM- 

iitH 

I0(H 



? : 
J 


T" 

6 " 

C 

6 . 





niM'WinR Khiseo m 


Figure A7: Number of DR's logged for OV-99* R18V90 field Ssstem 

(MISSN_1D=R9) . 
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Figure A9; Number of DF ' s logged Cor SPF, release 1 (MISSN^1D*S1) 
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Figure 50: 


Number of DR's lodged for SDL, release 36 (MISSN^ID’S6) . 
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Figure 52; Number of DR's logged for OFTl (MlSSN_in-T) . 
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Figure 5A; Number of ER ' s logged for STS-2, R17V5 (MISSN ID»W) 
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Figure 63: CR frequency for department 1 manpo^-er impact, year 2 

(D11MPYR2) . 
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Figure 65: OR frequency for departmt.it 1 manpower impact, vear 4 

(n: tm’>yr4) . 
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Figure 66: CR frequency for department 2 manpower impact, year 1 

(D2IMPYR1) . 
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Figure 67’ 


3R frequency for department 2 manpower impact, year 2 
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Figure 68: CR frequency for department 2 manpower impact, year 3 

(D2IMPYR3) . 
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Figure 69: CR frequency for department 2 manpower impact, year 4 

(D2IMPYR4) . 
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Figure 70; CR frequency for department 3 manpower inpact, year 1 
(D3IMPYR1) . 
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Figure 73: CR frequency for department 3 manpower mpact, year A 

(D3IHPYRA) . 
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Figure 75: CR frequency for department k manpower impact 

(D4IMPYR2) . 
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76; CR frequency for department 4 manpower impact, year 3 
(D4IMPYR3) . 
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Fi,^ure 78: CR frec^jency for department 5 manpower imca^t, yoar 1 

(D5IMPYR1>. 
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Figure 8A: CR frequency for departaent 6 aanpower inpact, year 3 

(D6IHPYR3) . 
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Figure 85; department 6 manpower impact, year « 
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Figure 87: CR frequency for depertnent 7 unpower iapact, year 3 

(D7IMPYR3) . 
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Figure 89: CR frequency for department 1 total manpower impact 

(DITOTIMP) . 
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(D3T0TIMP) . 
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Figure 96: DF frequency of number of months between date 

( OD) and development close date (BD) . 
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